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I.  Introduction 


A.  Hierarchy  of  Models 


Several  different  models  are  currently  in  use  for  the  (item*level)  analysis  of  the 
vulnerability  of  armored  fighting  vehicles  (AFV)  to  direct  fire  weapons.  As 
shown  by  Deitz  ^ ,  these  models  can  be  categorized  into  five  classes: 


•  Penetration  Models 

•  Lumped  Parameter  (Compartment)  Models 

•  Expected- Value  Point  Burst  Models 

•  Spare  Parts  Models 

•  Stochastic  Point  Burst  Models 


Table  1,  taken  from  Deitz  [op  cit.),  lists  a  number  of  those  models  and  their 
salient  features. 

However,  in  its  1989  report^  on  the  adequacy  of  vulnerability  analysis,  the 
Board  on  Army  Science  and  Technology  (BAST)  declared  that  the  above  hi¬ 
erarchy  was  both  incomplete  and  mis-directed.  In  particular,  the  BAST  indi¬ 
cated  that  effort  in  the  development  of  detailed  models  was  wasted.  Rather, 
they  maintained,  what  was  needed  was  another  level  of  modeling,  lying  be¬ 
tween  Penetration  and  Lumped  Parameter  Models,  which  would  presumably 
produce  results  of  an  accuracy  and  in  a  production  time  intermediate  to  those 
of  the  existing  models. 

It  is  the  purpose  of  the  present  study  to  verify  the  need  for  such  a  model 
and,  if  the  results  warrant,  determine  the  characteristics  (required  accuracy, 
allowable  time  for  a  study,  etc.)  that  such  a  model  must  possess  in  order  to 
fill  the  established  need. 

^Dr.  Paul  H.  Deitz,  Presentation  to  the  Blue  Ribbon  Panel  on  Vulnerability  Methodolo¬ 
gies,  USABRL,  1990 

^Armored  Combat  Vehicle  Vulnerability  to  Anti-armor  weapons;  A  Review  of  the  Army’s 
Assessment  Methodology,  Committee  on  a  Review  of  Army  Vulnerability  Assessment  Meth¬ 
ods,  Board  on  Army  Science  and  Technology,  Commission  on  Engineering  and  Techni¬ 
cal  Systems,  National  Research  Council,  National  Academy  Press,  Washington,  D.C., 
1989 


1 


Table  1:  Direct-Fire  AFV  Models 


METHODOLOGY  MODEL  APPLICATIONS  STRENGTHS/WEAKNESSES  PLANNED  IMPROVEMENTS 


Pcnclration  Performance 

•  Armor  (BH&T)  Design  +/-  Good  or  Bad  as  TBD  formulae  •  Closer  Ties  to  TBD  (Done) 

•  Warhead/Pen  Design  -I-  Overmatch  Metric  •  Merged  under  MUVES  (Done) 

Lumped  Parameter 

Compartment  Code/  •  Production  V/L  Support  -f- Minimal  Geometry  •  Merged  under  MUVES  (Done) 

VAMP  •  Concept  Vehicle  Design  -|- No  SpaH/PK.][I  Data  Req  •  Sensitivity  Analyses 

•  Lethality  Enhancement  -|-  Fast  Run  Times  •  Derivative  Correlation 

•  Compartment-Level  -f  Incls  Secondary  Kill  Mechanisms  Curves 

Studies  -  Applicable  only  to  Tested  Systems 

Expected-Value  Point  Burst 

SLAVE  •  Lethality  Enhancement  -f  One-Cone  Spall  Model  •  Future  MUVES  Merger 

•  Vulnerability  Reduction  -|-  Simple  PK|lis 

•  Component-Level  Studies  -  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 

SIMVA  •  Lethality  Enhancement  -|-  3-Cone  Spall  Model  •  Future  MUVES  Merger 

•  Vulnerability  Reduction  -1-  Simple  PK|Hs 

•  Component-Level  Studies  -  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 

STEVE  •  Lethality  Enhancement  Continuum  Spall  •  Future  MUVES  Merger 

•  Vulnerability  Reduction  -|-  Simple  PK[Hs 

•  Component-Level  Studies  -  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 

VAST  •  Lethality  Enhancement  -  M/V/S  Spall  Model  •  Future  MUVES  Merger 

•  Vulnerability  Reduction  -  M/V/S  PKjHs 

•  Component-Level  Studies  -  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 


Table  1:  Direct- Fire  AFV  Models 


METHODOLOGY  MODEL  APPLICATIONS  STRENGTHS/ WEAKNESSES  PLANNED  IMPROVEMENTS 
Spare  Parts 

VAST -f  •  Estimate  of  Damaged  Parts  -  M/V/S  Spall  •  Future  MUVES  Merger 

•  Estimate  of  Repair  Times  -M/V^SPK(Hs 

-  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 

SQuASH  +  •  Estimate  of  Damaged  Parts  -f  Full  Stochastic  Accounting  •  Future  MUVES  Merger 

•  Estimate  of  Repair  Times  +  Explicit  Damage  Vectors  •  Secondary  Kill  Mechanisms 

+  Simple  PKIHs 

-  Detailed  Geometry 

-  Fault-Tree  Analysis 

-  Damage  Mechanisms  Explicit 

Stochastic  Point  Burst 

SQuASH  •  Live-Fire  Predictions  -|-  Full  Stochastic  Accounting  •  Future  MUVES  Merger  (Oct  92) 

•  Lumped-Parameter  Calibration  -|-  Explicit  Damage  Vectors  •  Secondary  Kill  Mechanisms 

•  Vulnerability  Reduction  -1-  Simple  PK[Hs 

•  Lethality  Enhancement  -|-  Moderate  Spall 

•  Component-Level  Studies  -|-  Degraded  States  Option 

•  Research  Tool  -  Damage  Mechanisms  Explicit 

•  Stochastic  LF  Penetration  -  Detailed  Geometry 

-  Fault-Tree  Analysis 


B.  Approach 


Although  the  BAST  specifically  indicated  the  Equipment-Design  Community 
ais  the  beneficiaries  of  the  new  model,  it  was  decided  to  canvass  the  greater 
community  of  vulnerability  data  users  to  determine  where  the  unfulfilled  needs 
actually  lie.  The  approach,  therefore,  was  to  assemble  a  list  of  uses  and  users 
through  discussions  with  various  members  of  the  Vulnerability /Lethality  Di¬ 
vision  of  the  Ballistic  Research  Laboratory.  Interviews  were  then  conducted 
with  individuals  representing  each  level  of  use.  Finally,  the  findings  from  these 
interviews  were  collated  into  similar  needs  and  solutions  to  fill  those  needs  were 
proposed. 


It  must  be  noted,  therefore,  that  all  comments  and  opinions 
in  the  section  entitled  “Surveys”  are  those  of  the  inter¬ 
viewees,  as  faithfully  reproduced  as  memory  and  understanding 
serve  the  author.  The  “Summary  and  Recommendations”  section 
contains  a  synopsis  of  these  comments,  along  with  a  prima  facie 
evaluation  by  the  author. 

It  is  important  to  note  that  this  document  purposely  contains 
no  evaJuation  of  the  comments  and  opinions,  nor  rebuttal  of  any 
criticisms,  by  those  in  the  BRL  who  are  responsible  for  the  devel¬ 
opment  of  the  methodologies  which  form  the  subject  of  the  inter¬ 
views.  In  particular,  on-going  projects  which  address  some  of  the 
identified  shortfalls  are  not  described  in  this  document.  Rather,  it 
was  decided  to  confine  this  document  to  the  currently  held  view¬ 
points  of  the  users,  allowing  the  developers  publish  a  companion 
document  in  response. 
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II.  Users 


A  table  of  uses  and  users  of  direct-fire,  AFV  vulnerability  data  is  presented  in 
Table  2. 

Note  that,  in  a  very  loose,  qualitative  sense,  the  uses  are  arranged,  in  increasing 
order,  by  the  scope  of  the  studies  in  which  the  vulnerability  data  is  used. 
Conversely,  the  order  tends  to  reflect  a  decreasing  level  of  required  detail. 
(Exceptions  abound.  For  example,  it  has  been  pointed  out  that  warhead 
design,  although  involving  small  scope  and  presumably  high  detail,  is  aimed 
at  futuristic  (non-existent)  threats  for  which  little  detail  can  be  specified  for 
the  tcU’get.  However,  warhead  design  analyses  tend  to  remain  one-on-one, 
with  certain  selected  factors  (e.g.  armor  configuration)  hypothesized  with 
significant  detail.) 

The  credentials  of  the  specific  interviewees  were  established  as  follows.  In  all 
cases,  the  author  “entered  the  organization”  by  explaining  the  purpose  and 
scope  of  the  study  to  a  relatively  highly  placed  individual  in  the  organization 
to  be  interviewed.  The  actual  interviewees  were  specifically  designated  by 
these  individuals.  It  can  therefore  be  inferred  that  the  responses  received  were 
from  knowledgeable  sources. 


A.  Interview  Questions 


It  was  anticipated  that  the  responses  from  the  various  users  would  reflect  the 
wide  variation  that  exists  in  the  user  community.  However,  it  was  also  hoped 
that  common  requirements  would  emerge,  and  that  these  could  be  grouped 
into  sets  that  could  be  satisfied  by  the  various  available  models.  The  existence 
of  an  unsatisfied  set  would  therefore  constitute  a  verified  need  for  a  new  model. 

In  order  to  group  the  user  needs,  it  was  necessary  to  standardize  the  responses. 
An  attempt  was  made  to  standardize  the  questions  to  be  asked  of  respondents: 
The  goal  was  to  identify  those  salient  characteristics  that  are  truly  required 
of  a  vulnerability/lethality  methodology  to  meet  the  user’s  needs  without  un¬ 
duly  burdening  or  delaying  his  established  operating  procedures.  The  ideal 
response,  therefore,  would  be  a  typical  time-line  for  a  typical  product  of  an 
agency. 

However,  it  was  also  desired  to  encourage  the  interviewees  to  speak  freely. 
The  author  was  particularly  wary  of  Influencing  the  responses  by  his  phrasing 
of  questions.  Moreover,  several  of  those  interviewed  preferred  to  enumerate 
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Table  2:  Uses  and  Users  of  AFV  Vulnerability  Data 


USES-USERS 


BALLISTIC  RESEARCH  LABORATORY 

N 

•  Equipment  Design 

TACOM,  PMs 

Xi 

+J 

•  Warhead  Design 

MICOM,  ARDEC,  PMs 

•  Test  Prediction/Postdiction 

BRL,  AMSAA, 

TECOM 

0 

03 

& 

0 

Co 

•  Item-Level  Performance 

AMSAA,  PMs, 

JTCG/, 

•  SPARC 

AMSAA 

fd 

4J 

0 

•  Operational  Planning 

TRADOC 

High  Res. 

TRAC-WSMR, 

AMSAA 

E-h 

•  Force  Level  Models  Medium  Res. 

Low  Res. 

TRAC-FLVN 

CAA 

^  •  COEA.SSEB,  Ad  hoc  Studies 

TRAC  for  TRADOC 

wants  and  dislikes  directly.  Therefore,  the  attempt  to  make  a  standardized 
list  of  questions  to  be  asked  of  the  respondents  was  abandoned:  no  such  list 
was  made.  Rather,  the  author  adopted  the  following  interview  procedure: 


A.  Describe  the  interviewer’s  motivation;  viz:  to  determine  the  sufficiency 
of  the  suite  of  BRL  vulnerability  models. 

B.  Encourage  the  interviewee  to  speak  freely  on  his  uses,  problems,  likes 
and  dislikes  with  BRL  vulnerability  models/data. 

C.  If  the  interviewee  strays  too  far  from  the  above  topic,  bring  him  back  to 
the  subject  with  very  general  questions  such  as: 

•  Can  we  construct  a  time-line  for  a  typical  study/operation/etc.? 

•  How  accurate  are  the  results  of  your  studies?  How  is  that  accuracy 
affected  by  the  accuracy  of  the  vulnerability  data? 

•  How  much  expertise  does  your  organization  possess  in  the  areas  of 
vulnerability  analysis? 

•  What  other  limitations  do  you  have  on  your  operation? 

•  To  which  agencies  do  you  go  for  vulnerability  methodologies  or 
data? 

In  addition,  several  interviewees  had  comments  which  they  felt  were 
important  to  express;  some  even  had  pre-listed  such  comments  in  antic¬ 
ipation  of  the  interview.  If  germane  in  the  broad  scope  of  this  report, 
these  comments  are  included  in  the  appropriate  sections. 

The  conclusions  to  be  drawn  from  this  description  of  the  procedure  are 
as  follows: 

•  The  responses  of  the  interviewees  were  not  led  by  the  interviewer 
except  toward  the  broad  area  of  vulnerability  methodology  needs. 

•  Interviewees  were  encouraged  to  quantify  their  responses,  if  possi¬ 
ble. 

•  Finally,  interviewees  were  made  cognizant  of  the  broad  interests  of 
the  interviewer  and  were  thus  aware  that  any  needs  in  the  area  of 
vulnerability  analysis  were  appropriate.  Thus,  it  can  be  concluded 
that  the  absence  of  an  issue/complaint  is  significant. 
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III.  Surveys 


A.  Equipment  Design 

In  the  area  of  equipment  design,  several  offices/POCs  were  contacted. 
These  are  listed  in  Table  3, 


Table  3;  Equipment  design  offices  and  POCs  contacted 


TACOM;  RD&E  Center 
TACOM:  Armor  Division 
PM- Bradley 

PM-Survivability  Systems 

PM-AFAS 

PM-AMMOLOG 

PM-FARV 

General  Dynamics  Land  Systems 
General  Motors  Military  Vehicles 


COL  Kanda,  Dr.  Beck 

Mr.  Sam  Goodman 

MAJ  Burton 

Dr.  Terrence  Dean 

Mr.  T.  Kuriata 

Mr.  Juris  Miemis 

COL  Voss,  Dr.  Goble 

Dr.  Gary  Jackman 

Drs.  John  Waller,  John  MacBain 


1.  RD&E  Center 

Figure  1  shows  a  typical  timeline  for  the  development  of  a  tank  con¬ 
cept,  based  upon  discussions  held  at  TACOM.  For  comparison,  a  process 
flow-chart  taken  from  a  recent  TACOM  briefing  is  shown  in  Figure  2. 
Comparable  timelines  were  also  shown  in  briefing  packages  and  similar 
material  from  other  TACOM  projects. 

From  Figure  1,  several  user  requirements  can  be  extracted.  First,  the  de¬ 
signer  is  aware  of  the  advantage  of  incorporating  vulnerability  reduction 
concepts  early  in  the  concept  formulation.  Of  course,  guidance  at  this 
point  must  be  quite  generic,  stressing  the  application  of  ba^ic  vulnera¬ 
bility  reduction  principles.  Several  offices  asked  about  the  possibility  of 
developing  an  expert  system  type  of  program.  Such  a  progv£Lm  would 
ask  the  questions  and  give  the  insights  as  an  expert  (“a  Kirby”  ^  )  would 
do  were  he  part  of  the  concept  formulation  team.  A  more  resource  in¬ 
tensive  response  would  be  to  have  a  vulnerability  expert  participating 

^Mr.  Robert  Kirby,  USABRL,  established  (experienced)  expert  in  "ulnerability  analysis 
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Product  Format 


2  —  3  weeks 


1  week 


1 


2  months 


Several  months  —  years 


g 

e:; 


Initial  concept 
(Brainstorming) 


Refine 

selected 

concepts 


INTERGRAPH 

2D 


INTERGRAPH 
2-D  —  3-D 


Analyze  concepts, 
Select  one  for 
further  development 

_ _ I _ _ 


INTERGRAPH  BRL-CAD 
3-D 


Detailed  design 
(Contractor) 


INTERGRAPH  BRL-CAD 

2-D,  3-D 


Gross  estimate 
of  “weight  and 
space” 

Introduce 

(generic) 

vulnerability 

reduction 


Translate  2-D ' 
concept  to  3-D 


Weights  and 
balances, 
suspension 
design,  gross 
scale 

engineering 


Vulnerability  ' 

and  signature  Manufacturability 

analyses.  Cost 

OUTPUT;  Performance 

Relative 

ranking 


Point  Burst 

analysis  — 

detailed, 

specific 

vulnerability 

reduction 


Figure  1;  Typical  Timeline  for  the  Development  of  a  Tank  Concept 


USER  INITIAL 

requirements 

l.e. 

ARMOR  SCHOOL 
artillery  SCHOOL 
ENGINEERING  SCHOOL 
INFANTRY  SCHOOL 


USER  FINAL 
REQUIREMENTS 

l.e.  ROC 
O&O 
RFP 
SPEC'S 
COEA 

SHOP  DWGS 


CONCEPTUAL  DESIGN  -  ANALYSIS  PROCESS 


<--*ou+omotlc 


UPGRADE  TO  automatic 


ELIMINATE  PROCESS 


Figure  2;  Conceptual  Design  -  Analysis  Process  Flow-chart 


on  the  concept  formulation  team.  Unfortunately,  this  would  require  full¬ 
time  vulnerability  personnel,  a  concept  that  proved  unsustainable  in  the 
VAT^  project. 

The  next  place  at  which  vulnerability  considerations  enter  into  the  con¬ 
cept  process  is  in  the  first  evaluation  phase.  At  this  point,  the  concept 
has  been  somewhat  developed.  In  particular,  for  an  armored  vehicle, 
most  of  the  armor  package  has  been  specified.  (This  is  clearly  necessary 
in  order  that  the  “weights  and  balances”  analysis  can  be  done.)  Vul¬ 
nerability  analysis  is  needed  at  this  point  in  order  to  select  a  candidate 
concept  for  further  development;  i.e.,  analyses  need  only  determine  that 
“A  is  better  than  B”,  rather  than  produce  absolute  numbers  for  A  and 
B. 

This  lesser  requirement  is  in  keeping  with  the  still  low  detail  of  the 
concept  at  this  point.  Recall  that,  while  the  major  systems  have  been 
identified  and  “blocked-in”,  details  such  as  wiring  and  hydraulic  lines 
have  not  been  considered.  Thus,  vulnerability  analysis  at  the  compart¬ 
ment  level,  with  consistent  estimates  for  the  damage  correlation  curves, 
is  both  possible  and  appropriate. 

2.  Contractor 

Following  selection  of  a  candidate  concept,  the  initial  concepting  pro¬ 
cess  is  finished  and  the  surviving  candidate  goes  on  to  more  detailed 
development.  Often,  this  part  of  the  process  will  be  done  by  contrac¬ 
tors.  Therefore,  an  interview  was  held  with  analysts  from  two  armored 
vehicle  manufacturers.  At  the  time  of  the  interviews,  one  contractor 
(General  Dynamics)  was  in  production  of  a  major  weapon  system  (M-1 
tank).  The  other  (General  Motors)  has  developed  an  extensive  in-house 
capability  in  anticipation  of  contract  bidding. 

a.  General  Dynamics  A  requirement  for  BRL-CAD  target  descrip¬ 
tions  has  been  included  in  RFPs  for  certain  of  developmental  candidates. 
As  a  result,  contractors  are  producing  and  using  them  in  their  analyses; 
In  the  company  interviewed,  this  process  begins  at  the  beginning  of  the 
contractor’s  effort.  In  fact,  the  contractor  had  no  complaints  about  this 
requirement.  He  stated  that  the  company  strongly  favored  vulnerability 
modeling  and  analysis  from  the  beginning  of  their  effort.  Rather,  the 
contractor’s  complaints  came  in  two  areas:  the  user-friendliness  of  the 
BRL-CAD  and  the  state  of  the  analysis  codes. 

^Vulnerability  Analysis  Teams  (located  at  various  vulnerability  user  agencies)  -  a  project 
carried  out  in  the  1970s. 
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i.  User-friendliness  The  first  problem  that  arises  in  importing  a 
new  code  —  especially  one  that  involves  graphics  —  is  the  compatibility 
of  the  receiving  machine.  In  the  case  of  BRL-CAD,  the  compatibility  is¬ 
sue  extends  to  the  operating  system:  the  host  machine  must  run  UNIX. 
The  contractor  indicated  a  willingness  to  confine  his  work  to  UNIX  ma¬ 
chines,  although  that  imposed  a  significant  restriction  on  the  facilities 
at  his  disposal.  However,  the  graphics  terminals  which  he  must  use  are 
generally  not  the  same  as  those  used  at  the  BRL.  Therefore,  drivers  for 
his  terminals  —  and  maintenance  for  those  drivers  —  are  essential. 

(N.B.  The  contractor.  General  Dynamics,  is  a  very  laige,  big  budget 
operator.  Other  users  may  be  more  restricted  than  the  one  interviewed.) 

The  second  need,  also  identified  above,  is  for  an  automated  means  of 
transferring  computerized  descriptions  between  BRL-CAD  and  other 
CAD-CAM  packages.  In  this  case,  the  contractor  uses  Computervision’s 
CAD-CAM  package.  It  was  pointed  out  that  the  translation  is  not  just  an 
exercise  in  computer-science  and  geometry.  From  a  vulnerability  analy¬ 
sis  standpoint,  the  CAD-CAM  description  is  far  too  detailed,  containing 
a  prohibitively  large  number  of  inconsequential  components.  Thus,  some 
expert  judgement  must  be  involved  in  the  translation.  However,  the  con¬ 
tractor  stressed  that  these  difficulties  by  no  means  lessened  the  need  for  a 
technique  —  perha.ps  a  hjdn'id  of  automatic,  semi-automatic  and  manual 
steps  —  to  quickly  and  reproducibly  translate  between  CAD  systems. 

The  third  identified  need  was  for  a  much  improved  capability  to  make 
changes  in  existing  target  descriptions.  In  this  case,  the  application  was 
to  allow  the  user  to  incrementally  build  his  product  and  analyze  it  as  it 
develops.  For  example,  it  is  common  for  the  fire  control  system  (FCS) 
to  be  under  development  while  the  turret  and  hull  are  being  designed. 
Thus,  for  the  first  vulnerability  analyses  of  the  turret-hull,  the  FCS  is 
represented  by  boxes  of  appropriate  size  and  constitution.  The  impor¬ 
tance  of  being  able  to  easily  substitute  a  model  of  the  actual  FCS  when 
available  was  stressed.  (This  need  will  be  further  developed  in  the  fol¬ 
lowing  sub-section.) 

ii.  Code  maintenance  The  contractor’s  major  complaints  dealt  with 
the  state  of  the  vulnerability  analysis  codes  which  use  the  BRL-CAD 
geometric  models.  Apparently,  the  contractor  has  found  numerous  er¬ 
rors  and  shortcomings  in  BRL-supplied  codes  such  as  VAMP,  VAST  and 
SLAVE.  These  shortcomings  included  such  problems  as  inconsistent  and 
incomplete  penetration  models,  lack  of  fault  trees  (VAST)  and  outright 
coding  errors. 
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The  user  also  asked  about  the  availability  of  SQuASH,  stating  that  the 
common  use  of  a  state-of-the-art  model  might  improve  the  level  of  model 
maintenance. 

(Note:  Although  the  user  recognized  the  need  to  use  a  point-burst  type 
model,  the  RFP  to  which  he  was  responding  called  for  a  compartment 
model  (VAMP)  to  be  used  in  the  analysis.) 

b.  General  Motors  Reflecting  their  current  activities  in  the  ar¬ 
mored  vehicle  development  and  acquisition  process,  the  individuals  from 
General  Motors  concentrated  most  of  their  comments  in  the  area  of  con¬ 
cept  design  and  evaluation.  In  this  area,  recent  experiences  had  uncov¬ 
ered  several  shortfalls  in  the  evaluation  process,  some  of  which  may,  in 
part,  be  alleviated  by  methodological  extensions. 

i.  Evaluation  of  conceptual  vehicles  The  concerns  of  the  inter¬ 
viewees  fell  into  two  broad  classes.  First,  the  simplified  vulnerability 
analyses  that  are  done  (by  the  user-evaluator)  discredit  some  good  vul¬ 
nerability  practices.  For  example,  many  simple  models  automatically 
score  a  penetration  into  a  fuel  tank  as  a  kill.  However,  redundant  fuel 
tanks,  placed  outside  of  the  armored  compartment,  can  actually  serve 
as  a  shield  and  a  shaped-charge  pre-initiator.  Thus,  such  simple  models 
may  actually  penalize  good  vulnerability  practices.  Since  this  happens 
early  in  the  design  process,  many  bold,  new  concepts  will  be  suppressed 
before  the  more  sophisticated  evaluations  can  be  applied  —  a  suppression 
resulting  not  from  shortfalls  in  the  concepts  but  from  the  artificialities 
introduced  by  the  simple  evaluation  tools  employed. 

The  requested  methodological  fixes  to  this  problem  are: 

•  Expansion  of  the  tools  used,  e.g.  by  TACOM,  at  the  concept  eval¬ 
uation  stage  to  credit  good  vulnerability  practices. 

•  The  insertion  of  stochastic  factors  into  the  simple  tools.  (Even 
the  compartment  model  could  incorporate  the  stochastic  nature  of 
penetration,  e.g.,  resulting  in  significantly  increased  realism  with 
little  increase  in  labor.) 

As  a  measure  of  the  level  of  detail /complexity  of  models  that  are  used  at 
this  stage  of  concept  development,  it  was  pointed  out  that  analysts  will 
always  lag  behind  the  designers.  However,  a  response  time  of  3  -  4  days 
is  sufflcient  to  maintain  the  pace  of  a  normal  concept  design  process. 

The  second  concern,  one  voiced  by  many  individuals  in  competitive  sit¬ 
uations,  deals  with  the  disadvantage  that  an  honest  evaluator  may  face 


when  making  “subjective”  choices.  For  example,  in  cases  in  which  stan¬ 
dard  data  is  not  available,  analysts  appear  to  be  free  to  slant  the  surro¬ 
gate  data  to  best  serve  their  own  causes.  Similarly,  situations  not  covered 
by  standard  analysis  tools  (e.g.  multiple  hits  on  rugged  components)  can 
be  interpreted  in  the  analyst’s  best  interests. 

The  fixes  to  this  set  of  concerns  are  more  procedural  than  methodological 
and  are  the  responsibility  of  the  evaluator  {e.g.,  TACOM)  rather  than  of 
the  BRL.  However,  the  BRL  may  be  able  to  assist  in  the  following  ways: 

•  Keep  a  current  standard  library  of  penetration  codes  and  associated 
data  (e.g.  efficiencies).  This  would  allow  the  user  (e.g,,  TACOM) 
to  more  precisely  specify  the  analysis  tools  to  be  used  on  a  project. 

•  Serve  as  an  arbiter  in  evaluations,  thus  removing  subjective  deci¬ 
sions  from  those  with  vested  interests. 

ii.  Methodological  improvements  The  individuals  at  General  Mo¬ 
tors  were  unreserved  in  their  praise  for  BRL-CAD,  calling  it  “the  best 
solid  modeler  available”.  In  fact,  after  doing  a  design  using  a  conven¬ 
tional  engineering  CAD  package  (ANVIL  5000),  the  designers  will  use 
a  concurrent  BRL-CAD  model  of  the  design  to  check  for  the  fit  of  the 
various  pieces.  However,  every  one  of  the  designers  stressed  that  the 
BRL-CAD  was  a  complement  to  their  CAD  tools,  not  a  replacement. 
The  extensive  engineering  features  built  into  engineering  CAD  packages 
and  intensively  maintained  by  large  software  companies  are  extremely 
valuable  and  appreciated  by  design  engineers.  Therefore,  the  need  for 
translators  from  engineering  CAD  packages  to  BRL-CAD  immediately 
came  up.  The  General  Motors  staff  had  developed,  in-house,  a  translator 
from  ANVIL  to  BRL-CAD.  Although  quite  primitive  (it  only  translates 
solids)  and  manpower-intensive,  the  tool  saves  significant  time  for  the 
group  and  is  considered  a  minor  triumph. 

The  group  also  boasted  of  an  in-house  developed  translator  from  BRL- 
CAD  directly  into  a  finite  element  representation  of  a  target  which  by¬ 
passed  the  need  to  use  PATRAN. 

In  the  area  of  analysis  models,  it  was  pointed  out  that  a  number  of  mod¬ 
els  use  similar  inputs  or  have  similar  algorithms.  However,  current  tools 
require  the  analyst  to  tie  a  series  of  runs  together:  for  example,  MGED  - 
VDECK  -  GIFT/RIP.  A  standard  library  of  routines  and  models  which 
could  be  automatically  tied  together  was  seen  as  a  significeint  time  sav¬ 
ings  as  well  as  an  enhancement  in  the  consistency  and  comparability  of 
various  analyses. 


In  a  more  theoretical  sense,  the  meaning  of  some  vulnerability  measures 
was  questioned.  For  example,  the  interpretation  of  =  0.5  as  a  50% 
probability  of  no  function  versus  a  constant  50%  decrement  in  function 
was  brought  up. 

Finally,  the  usefulness  of  a  “survivability  designers  handbook”  was  ex¬ 
pressed.  Such  a  work  could  include,  for  example,  live  fire  results  and  data 
as  well  as  a  compilation  of  good  survivability  practices.  However,  the 
interviewees  stressed  that  the  necessary  simplicity  of  such  a  handbook 
made  it  prone  to  be  strongly  scenario-dependent.  Furthermore,  there 
might  be  a  temptation  for  evaluators  to  use  such  a  book  as  a  “report 
card  that  take  the  place  of  actual  vulnerability  analysis”,  which  would 
be  a  serious  disservice  to  the  production  of  survivabile  vehicles. 

iii.  Procedural  expansions  The  General  Motors  group  also  broached 
the  subject  of  communication  between  government  laboratories  and  in¬ 
dustry.  The  importance  of  “Industry  Days”  was  brought  out.  However, 
such  open  fora  are  inappropriate  for  the  transmittal  of  specialized  and,  in 
particular,  classified  data.  Although  this  observation  lies  outside  of  the 
scope  of  this  report,  it  is  worth  noting  that  organizations  —  especially 
those  involved  in  competitive  design  projects  —  may  have  a  difficult  time 
getting  the  data  upon  which  to  base  decisions.  This,  in  turn,  limits  the 
choices  made  available  to  the  user-evaluator. 


3.  PM-AFAS 

The  observations  of  the  AFV  contractor  were  echoed,  very  independently, 
by  the  point  of  contact  at  PM-AFAS.  In  anticipation  of  the  interview, 
the  POC  had  assembled  a  list  of  needs/shortcomings.  These  included: 

1.  BRL-CAD  is  unique  in  commercial  world  and  hard  to  learn. 

•  Many  CAD-CAMs  currently  in  use.  Forcing  contractor  to  use 
BRL-CAD  is  very  expensive. 

•  Documentation  for  BRL-CAD  was  totally  insufficient  for  users; 
must  get  education  directly  from  the  BRL 

•  Succinct  guidelines  needed,  especially  for  level  of  detail  re¬ 
quired,  fault  tree  construction  and  similar  qualitative  decisions. 

2.  Do  not  have  a  generic  “damage  assessment”  list;  thus,  are  hindered 
in  ability  to  conduct  vulnerability  analyses  early  in  program.  Need 
damage  assessment  lists  from  previous  studies. 
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3.  Need  ability  to  do  “what-if”  drills.  Given  a  model  (from  contrac¬ 
tor),  must  be  able  to: 

•  “Turn-off”  components 

•  Change  material  codes 

•  Move  simple  components,  add  armor,  etc. 

In  the  standard  (45  day)  time  schedule  for  response  to  a  contractor’s 
proposal,  the  POC  felt  that  two  weeks  might  be  allowed  for  doing 
“what-if”s. 

4.  Related  to  the  need  to  relocate  simple  components;  Need  ability  to 
do  simple  movements  of  movable  components:  e.g.  rotate  turret, 
elevate  gun.  (Difficulty  with  flexible  components  is  acknowledged.) 

The  POC  also  discussed  the  need  for  someone  —  preferably  the  BRL  as 
the  Army’s  center  of  expertise  for  vulnerability  —  to  verify  the  target 
description/analysis  done  by  contractors.  For  example,  if  a  contractor 
neglected  to  put  a  critical  component  into  his  description  or  into  his  fault 
tree,  the  contractor  would  be  rewarded  with  a  less  vulnerable  product. 


4.  Mature  Systems 

The  requirements  for  vulnerability  analysis  of  mature  systems  are  not 
qualitatively  different  from  those  of  a  developmental  system  in  the  “what- 
if”  stage.  The  POC  at  PM-Bradley  was  very  complimentary  about  the 
BRL  support  in  the  area  of  vulnerability  analysis  in  sharp  contrast  to 
the  delays  involved  in  contractual  support.  However,  he  did  acknowledge 
that  the  response  times  would  certainly  be  different  if  a  highly  detailed 
target  description  did  not  exist. 

Vulnerability  analysis  in  support  of  a  mature  system  falls  mainly  into 
two  classes:  support  of  live-fire  tests  and  conduct  of  “what-if”  studies 
for  PIPs.  The  former  will  be  discussed  below. 

The  conduct  of  “what-if”  studies  presents  an  opportunity  to  improve  the 
BRL  vulnerability  tools.  The  typical  “what-if”  study  involves  making 
minor, but  finite,  physical  changes  to  a  vehicle:  typical  are  addition  of 
armor  or  the  movement/interchange  of  a  few  components.  The  typical 
time  budget,  independently  elucidated  by  several  of  those  interviewed, 
was  1-2  weeks,  allowing  only  a  day  or  two  to  make  any  changes  in  the 
target  description.  To  the  uninitiated,  this  appears  to  be  more  than 
ample  time.  However,  the  interviewee  pointed  out  that  BRL-CAD  was 
designed,  built  and  optimized  for  the  construction  of  new  target  descrip¬ 
tions.  In  the  process,  decisions  may  have  been  made  to  take  advantage  of 
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the  situation  generally  prevailing  in  the  construction  of  a  new  description; 
For  example,  the  describer  tends  to  be  familiar  with  the  whole  target, 
tends  to  plan  ahead  and  tends  to  allocate  space  for  all  components  in 
an  area  before  modeling  any  of  them.  These  conditions  generally  do  not 
pertain  when  minor  adjustments  are  being  made  to  existing  descriptions. 
Interactive  tools  are  needed  which  would  facilitate  simple  changes  in  a 
model  from  the  viewpoint  of  an  analyst  unfamiliar  with  the  details  of 
the  baseline  description. 

The  importance  of  “what-iPs,  upgrades  and  PIPs,  other  analyses  that 
may  involve  modifications  of  old  equipment  was  underlined  by  those  in¬ 
terviewed  in  the  TACOM  Survivability  Division.  Those  interviewed  feel 
that  Congress  will  be  ever  more  unwilling  to  buy  brand  new  equipment. 
Thus,  redesign  and  upgrading  of  current  materiel  will  become  increas¬ 
ingly  important. 


5.  Other  considerations 

Other  points  brought  out  in  the  interviews: 

1.  Vulnerability  analysis  cannot  be  limited  to  penetrating  munitions. 
For  example,  the  impact  shock  from  a  heavy,  hypervelocity  missile 
striking  the  turret  of  a  tank  might  be  enough  to  render  the  tank 
inoperable,  even  if  penetration  of  the  armor  never  occurred. 

2.  Almost  all  vulnerability  analyses  end  up  in  comparisons.  It  is  ex¬ 
tremely  important  (and  sometimes  very  difficult)  to  assure  that  the 
same  measures  of  effectiveness  are  applied  to  all  candidates.  Simi¬ 
larly,  studies  done  at  different  times  are  very  apt  to  have  different 
assumptions  built  into  them.  (For  example,  perceptions  of  foreign 
threats  change  over  time.)  It  is  important  that  the  BRL  (which  has 
the  final  “imprimatur”  on  vulnerability  data)  is  able  to  (re)generate 
large  amounts  of  data  at  one  time  in  order  to  guarantee  identical 
assumptions. 

3.  Vulnerability  analyses  should  be  accompanied  by  confidence  bounds. 
These  should  reflect  —  at  least  —  the  uncertainty  in  the  input  data. 
At  best,  uncertainties  introduced  by  the  methodology  employed 
should  be  included.  (For  example,  the  uncertainties  accompanying 
a  compartment  model  run  should  reflect  the  assumptions  made  in 
using  damage  correlation  curves. 

4.  The  BRL  role  as  “honest  broker”  is  extremely  important  to  the 
community. 
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6.  Summary  of  Equipment  Designers’  Needs 

a.  Computer  Methodologies  In  addition  to  those  vulnerability/lethality 
tools  currently  in  use,  the  equipment  design  community  appears  to  have 
need  for  the  following  tools: 

•  Easy  to  use  guidelines  to  aid  the  designer  early  in  the  design  process. 
Several  users  mentioned  the  possibility  of  an  “expert  system”  for 
the  designers. 

•  Augmentation  of  simple  models  (fundamental  compartment  or  follow- 
on  models)  to  better  credit  good  survivability  practices  and  include 
stoch£istic  factors) 

•  An  interface  between  the  engineering  tools/computerized  drawings 
ajid  the  BRL-CAD  system. 

•  Automated,  computer-efficient  large  batch-run  capability  (possibly 
at  the  BRL)  to  support  Procedural  Augmentation  2  below. 

b.  Time  Budgets  With  the  exception  of  generic  guidelines  to  be 
used  in  the  initial  concept  phases,  there  appears  to  be  no  justifiable 
need  for  one  hour  turn-around  of  vulnerability  analyses.  (Of  course,  “in 
the  best  of  all  worlds”,  an  interactive  capability  would  be  of  some  use.) 

On  the  other  hand,  several  developers  mentioned  the  need  for  one  week 
turn-around  of  “what-if”  level  analyses. 

Finally,  for  a  brand-new  concept,  it  appears  that  one  month  would  be  a 
suitable  turn-around  time,  since  other  analyses  (e.g.  weight  and  balance) 
are  proceeding  simultaneously. 


c.  Procedural  Augmentations  The  following  procedural  points  were 
also  brought  out; 

1.  The  VLD  should  be  involved  early  in  the  design  phase  of  an  item. 
“Survivability  people  should  be  on  the  design  team.” 

2.  When  providing  data  that  a  requester  is  going  to  use  in  a  compari¬ 
son  of  two  items,  or  when  competing  agencies  are  producing  items 
that  are  going  to  be  compared,  it  is  essential  that: 

•  MOEs  be  consistent 

•  ALL  factors  be  IDENTICAL,  varying  only  those  involved  in 
the  comparison. 

•  Standardized  evaluations  methodologies  and  data  be  used  by 
all  parties  for  all  items  being  compared. 
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These  ends  may  be  best  met  by  (re-)running  all  data  in  one  batch. 

3.  Confidence  bounds  should  be  published  with  all  VLD  output. 

4.  There  must  be  constant,  high-quality,  responsive  maintenance  of 
the  standard  vulnerability  codes. 

5-  The  VLD  must  continue  to  be  the  honest  broker  of  vulnerabil¬ 
ity  data.  Similarly,  the  VLD  is  often  the  best  placed  government 
agency  to  serve  as  arbiter  for  non-standard  cases. 

6.  “Farming  out”  vulnerability  analyses  to  contractors  is  costly  in  both 
money  and  credibility. 

B.  Warhead  Design 

1.  PM-TMAS 

In  the  warhead  design  community,  only  PM-TMAS  was  contacted;  the 
point-of-contact  was  Mr.  S.  Rachlin. 

Although  (as  expected)  much  of  the  warhead  design  community’s  BRL 
interaction  is  with  the  Terminal  Ballistics  Division,  PM-TMAS  has  a 
substantial  interaction  with  Ground  Systems  Branch.  This  evolves  from 
the  fact  that  warhead  design  involves  factors  other  than  pure  penetration, 
for  example,  round-to-round  dispersion. 

The  time  line  in  the  Warhead  Design  community  is  quite  simple.  As  soon 
as  someone  comes  up  with  an  idea,  the  managers  ask  “How  effective  will 
it  be?”  Because  of  the  interaction  of  parameters,  the  best  answer  to  that 
question  is  lethality,  not  just  penetrability.  '  - 

A  significant  problem  in  returning  an  answer  to  a  new  concept  is  the  com¬ 
plexity  of  the  interaction  of  a  warhead  with  the  new  active  and  passive 
armors.  It  is  appreciated  that  no  simple  formulas  or  analytical  techniques 
exist  to  predict  the  performance  of  a  radically  new  projectile  or  shaped 
charge  against  the  modern  armors.  Thus,  the  time  is  needed  for  the 
Terminal  Ballistics  Division  (BRL)  to  produce  its  best-guess  algorithms 
for  penetration. 

On  the  other  hand,  there  is  no  need  to  update  the  target  group  for  every 
new  concept  (as  in  vulnerability  studies). 

The  desired  turn-around  time  for  a  typical  “what-if”  request  is  1  /2  day; 
a  reasonable  turn-around  time  is  1/2  week.  Here,  a  “what-if”  request  is 
defined  as  one  that  involves  only  a  simple  change  in  a  warhead  parameter 
(e.g.  “What  if  the  rod  were  5  cm.  longer?  what  if  the  striking  velocity 
were  100  m/sec  faster?”)  In  the  case  of  a  more  radical  warhead  change. 
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the  turn-around  time  would  have  to  reflect  the  increased  time  needed  to 
estimate  the  new  concept’s  penetration  capabilities  against  the  various 
armor  configurations.  However,  it  would  often  be  of  significant  value  to 
the  developer  if  conditional  (“top-of-the-head”)  estimates  of  penetration 
performance  could  be  run  against  a  standard  series  of  targets  to  indicate 
whether  the  warhead  is  even  “in-the-ballpark”. 

As  for  accuracy,  for  simple  “what-if”  requests,  data  that  would  result 
in  ±5%  in  PK/shoi  is  great.  Note  that  pKfahot  involves  grid  cell  data  in 
a  weighted  average  around  all  aspects  of  the  target,  as  well  as  several 
other  parameters:  thus,  the  above  accutacy  requirement  is  less  stringent 
than  a  requirement  on  the  vulnerability  data  itself. 

The  time-requirements  for  new  targets  was  quite  loose.  The  POC  pointed 
out  that  the  warhead  designer  is  almost  always  concerned  about  future 
foreign  targets,  rather  than  ones  that  are  currently  fielded.  These  targets 
are  commonly  based  upon  intelligence  estimates  of  foreign  technological 
progress,  extrapolated  out  5  to  20  years.  Clearly,  not  much  confidence 
can  be  placed  in  the  specifics  of  an  estimate  actually  becoming  a  real¬ 
ity.  However,  it  is  essential  that  the  warhead  designer  have  a  yardstick 
by  which  to  measure  the  performance  of  his  product.  Thus,  the  most 
important  characteristics  of  the  target  description  are  not  its  specific 
features,  but  rather  its  ability  to  act  as  a  standard  for  compajison  that 
is  applicable  in  the  mid-  to  far-term.  This  translates  into  two  basic 
requirements: 

•  The  description  is  accepted  as  representative  of  the  time-period. 

•  The  description  is  stable. 

The  result  is  that,  once  a  new  target  is  “blessed”  by  DCSINT,  the  war¬ 
head  developers  would  like  to  have  the  description  brought  up  and  used 
in  analyses.  However,  to  be  a  yardstick,  it  is  essential  that  the  new 
version  be  calibrated  against  its  predecessor;  i.e.,  all  previous  runs  must 
be  re-done.  In  particular,  if  a  comparison  is  being  made  by  anyone,  it 
is  essential  that  warhead  A  —  fired  against  the  new  version  of  a  tar¬ 
get  —  be  compared  against  warhead  B,  fired  against  the  same  version. 
Methodologically,  this  translates  into  a  need  for  an  automated  means 
of  re-running  a  complete  set  of  analyses  as  a  standard  response  for  any 
data  request. 

The  POC  was  very  sympathetic  to  the  work  load  at  the  BRL  as  well 
as  the  need  to  maintain  the  quality  of  the  BRL  products.  However, 
he  suggested  procedural  changes  to  improve  the  interaction  between  the 
BRL  and  the  warhead  designers.  Primary  among  these  is  the  need  to 
establish  a  single  point-of-contact  to  expedite  a  data  request.  The  POC 
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saw  the  BRL  as  being  highly  compaitmented  and  pointed  out  that  it 
was  quite  difficult  for  an  outsider  to,  individually,  make  the  necessary 
contacts  within  TBD  and  VLD  in  order  to  get  a  “vvhat-if”  analyzed. 
He  also  complained  that  the  VLD  would  not  accept  weapon  parameters 
(such  as  penetrator  velocity)  directly  from  him,  implying  that  internal 
red-tape  artificially  extends  his  turn-around  time. 


2.  Summary  of  Warhead  Designer  Requirements 

The  warhead  designers  do  not  appear  to  need  any  radically  new  method¬ 
ologies.  However,  they  do  require  the  VLD  standard  methodologies 
(compai'tment  and  point-burst)  to  be  amenable  to  quickly  changing  pen¬ 
etration  equations/models  to  account  for  extended  performance  against 
complex  armors.  To  implement  a  new  penetration  phenomenon  or  new 
standard  future  target,  automation  of  batch-runs  may  be  required. 

The  warhead  designers  would  benefit  from  the  procedural  changes  listed 
in  c.,  above.  In  addition,  the  designation  of  a  single  expediter  in  BRL 
for  vulnerability  requests  would  greatly  simplify  the  interface  between 
the  designer  and  the  BRL. 


C.  Test  Prediction/Postdiction 

Although  the  author  believes  that  the  area  of  test  prediction  and  the 
analysis  of  test  results  (postdiction)  are  important  applications  of  vul¬ 
nerability  methods,  he  was  unable  to  find  an  agency  as  deeply  involved 
in  the  area  as  is  the  Ballistic  Research  Laboratory.  It  was  therefore  de¬ 
cided  to  include  pertinent  sections  from  BRL  MR-MR-3755  (P.  H.  Deitz 
and  A.  Ozolins,  Computer  Simulations  of  the  Abrams  Live-Fire  Field 
Testing,  May  1989)  to  characterize  the  role  of  vulnerability  analysis  in 
this  area.  However,  it  was  also  desired  to  restrict  the  material  in  these 
sections  to  comments  expressed  by  those  outside  of  the  BRL.  Therefore, 
the  included  sections  of  BRL-MR-3755  have  been  placed  in  Appendix  A. 

D.  Item-Level  Performance 

The  Army’s  leading  agency  for  item-level  analyses  is  AMSAA.  Accord¬ 
ingly,  an  interview  was  held  with  Mr.  Will  Brooks  of  the  Ground  Warfare 
Division  (GWD)  concerning  the  roles  of  and  needs  for  vulnerability  data 
at  the  item-level. 
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Although  some  use  is  made  of  item- level  data  directly,  most  of  the  vulner¬ 
ability  data  sent  to  GWD  is  used  to  generate  single  shot  kill  probability 
(SSKP)  data  for  larger  studies.  Examples  of  such  studies  are  the  Ammo 
Rates  studies  of  the  CAA  and  various  COEAs.  The  role  of  AMSAA  is 
to  add  the  characteristics  of  weapon  systems  to  the  vulnerability  data 
to  produce  SSKPs.  As  discussed  below,  the  CAA  requests  generally  do 
not  require  the  generation  of  totally  new  data;  rather,  what  is  required 
is  reprocessing  of  old  targets,  data,  etc. 

For  a  COEA,  a  new  concept  —  requiring  a  new  target  description  —  may 
be  involved.  Ideally,  this  should  not  be  a  problem;  1)  several  months 
are  generally  scheduled  for  the  data  gathering  portion  of  a  COEA  and 
2)  there  is  an  good  chance  that  a  target  description  had  been  constructed 
during  equipment  development.  As  a  result,  responsiveness  is  generally 
not  a  big  problem  for  this  application. 

The  basic  BRL  supplied  data  consists  of  4”  cell  data  for  PK  and  SSPK. 
For  the  latter,  data  is  correlated  into  weighted  sums  by  convoluting 
the  cell  data  with  standard  (normal)  dispersion  distributions  centered 
about  standard  aimpoints.  AMSAA  uses  the  4”  data  to  calculate  SSKPs 
with  biases,  associates  each  data  set  with  the  applicable  weapon-range- 
conditions  and  passes  it  on  to  higher  level  users. 

In  summary,  the  problems  involved  at  the  item-level  are  not  different 
from  those  at  other  levels;  in  fact,  during  the  interview,  Mr.  Brooks 
mentioned  several  problems  and  potential  solutions  discussed  in  other 
sections  of  this  report.  In  particular,  he  referred  to  the  problem  of 
many  concurrent  studies  competing  for  limited  analytical  resources.  The 
main  difference  introduced  at  this  level  is  the  need  for  large  sets  of  data 
since  COEAs  require  large  scale  simulations  which,  in  turn,  involve  many 
weapon-target  pairs.  For  this  reason,  automation  of  the  methodologies 
and  procedures  for  selecting  surrogates  and  rapid  re-running  of  analyses 
promises  benefits  at  this  level. 


E.  SPARC 

SPARC  (Spare  Parts  And  Repair  for  Combat)  is  a  highly  specialized 
application  of  vulnerability  methodologies.  In  SPARC  analyses,  vulner¬ 
ability  studies  are  done  that  calculate  probabilities  of  damage  to  specific 
components.  Results  for  each  shotline  are  tabulated  by  part  name,  num¬ 
ber  and  repair  time.  As  the  name  implies,  SPARC  analyses  are  part  of 
the  continuing  process  to  maintain  existing  US  combat  vehicles  and  are 
therefore  applicable  to  type-classified  US  systems  and  not  to  concept 
vehicles/systems. 
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As  was  the  case  with  Test  Prediction/Postdiction,  the  most  experienced 
office  in  the  subject  area  was  in  the  BRL,  in  this  case,  the  Logistical  and 
Tactical  Targets  Branch  (LTTB)  of  the  Vulnerability/Lethality  Division. 
However,  since  LTTB  has  little  direct  involvement  in  the  development 
of  the  BRL  methodologies  being  reviewed  in  this  study,  it  was  felt  that 
the  LTTB  contribution  to  this  document  involved  little  conflict  of  in¬ 
terest.  Therefore,  for  the  sake  of  continuity,  it  was  decided  to  leave  the 
information  on  SPARC  in  place  here,  rather  than  relegating  it  to  an 
appendix. 

The  level  of  detail  required  to  model,  simulate  and  account  for  thousands 
of  components  is  extreme:  recall  that  spare  parts  include  such  small  but 
important  components  as  wire  bundles,  gauges  and  manual  controls.  As 
a  result,  the  demands  of  SPARC  far  out-weigh  the  demands  customarily 
placed  upon  the  vulnerability  code  (VAST  or  SQuASH)  which  has  been 
adapted  for  SPARC  use. 

Typically,  a  SPARC  analysis  requires  in  excess  of  one  man-year  of  effort. 
However,  the  bulk  of  this  effort  is  in  translating  the  information  on  each 
part  —  usually  from  cards  (“aperture  cards")  which  contain  micro-filmed 
blue  prints,  one  part  per  card  —  into  a  data  entry  for  a  ray-trace  routine. 

Two  methodological  improvements  were  discussed  by  LTTB.  In  short, 
there  is  need  for  an  automated  procedure  to  assist  with  the  extraction 
of  data  from  the  aperture  cards.  (The  author  points  out  that  some  of 
this  data  might  possibly  be  intercepted  before  it  is  printed  out  in  “hard¬ 
copy”  and  microfilmed  for  the  aperture  cards,  i.e.  while  still  in  the 
manufacturer’s  CAD/CAM  format.) 

A  second  methodological  possibility  brought  up  by  the  LTTB  was  that  of 
developing  relationships  that  would  allow  a  counter-part  to  the  compart¬ 
ment  code  methodologies  for  application  to  SPARC.  In  such  a  method¬ 
ology,  the  exterior  and  major  shielding  components  would  be  included 
in  the  target  description.  However,  the  probability  of  component  loss 
would  be  estimated  from  such  factors  as  residual  penetrator  and  hole 
size,  component  presented  area,  location  (compartment)  and  vulnerabil¬ 
ity  parameters. 

However,  it  was  agreed  by  all  that  the  methodological  enhancements 
listed  above  were  not  general  vw/nerafii/tfi/ methodology  issues,  per  se,  but 
were  specific  to  the  SPARC  problem.  It  may  happen,  for  example,  that 
techniques  adopted  for  the  translation  of  the  engineering  tools/computerized 
drawings  into  the  BRL-CAD  system,  discussed  above,  may  have  spin¬ 
off  value  here.  However,  it  was  concluded  that  the  general  vulnerability 
tools  (ray-trace  routines,  penetration  algorithms,  etc.)  which  were  di¬ 
rectly  applicable  to  SPARC  analyses  were  quite  adequate  and  introduced 
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no  new  requirements  for  the  purposes  of  this  study. 


F,  Operational  Planning 

1.  US  Army  Armor  Center 

The  broad  area  of  operational  planning  includes  not  only  those  stud¬ 
ies  needed  to  develop  tactical  concepts,  but  also  those  that  focus  upon 
the  effects  of  new  technology /equipment  upon  military  operations.  In¬ 
evitably,  vulnerability /lethality  data  is  required. 

Operational  planning  for  each  mission  area  is  generally  the  responsi¬ 
bility  of  the  cognizant  TRADOC  school.  Responsibility  for  the  Close 
Combat  -  Heavy  (CCH)  mission  area  lies  with  the  Directorate  of  Com¬ 
bat  Developments  at  the  Armor  School  at  Fort  Knox.  In  that  school, 
all  vulnerability  data  is  channeled  through  Mr.  Larry  Vowels  who  was 
chosen  as  the  expert /interviewee  for  this  section. 

Generally  speaking,  vulnerability  data  is  not  sent  directly  to  Ft.  Knox. 
Rather,  data  that  is  received  and  stored  has  been  combined  with  firing 
accuracy  data  to  produce  probability  of  kill  given  a  shot  and  given  a  hit 
{Pk/s  and  Pk/h)-  Most  commonly,  the  needed  PkS  have  been  generated 
by  AMSAA  and  either  entered  in  the  AMSAA  “Series  G”  Handbook 
or  sent  to  TRAC-WSMR,  which  is  a  regular  data  source  for  the  Armor 
School.  In  those  cases  in  which  Mr.  Vowels  had  to  request  vulnerability 
data  directly,  he  was  forced  to  generate  the  needed  PkS  by  hand,  quite 
an  arduous  process. 

Currency  of  vulnerability  data  is  a  greater  concern  than  precision  at  the 
Armor  School.  This  statement  follows  from  the  uses  of  vulnerability 
data.  First  of  all,  the  usual  intermediate  outputs  from  analyses  which  go 
into  an  operational  planning  decision  are  at  the  force  rather  than  system 
level.  Therefore,  fine  details  in  the  vulnerability  data  are  lost  in  the 
averaging  processes  that  are  necessary  to  reduce  the  volume  of  data  to 
an  amount  that  can  be  handled  in  a  force  level  analysis.  Vulnerability 
data  is  combined  with  accuracy  data  and  then  averaged  over  all  azimuths. 
Thus,  the  massive  amount  of  data  generated  by  the  BRL  for  one  round 
against  one  target  is  reduced  to  a  few  numbers  that  give  probability  of 
M,  F  or  K  kill  at  two  or  three  ranges.  (Force  level  models  are  discussed 
further  in  the  subsequent  section.) 

Secondly,  the  decisions  being  made  tend  to  be  of  a  relative  nature  and 
only  involve  vulnerability /lethality  factors  indirectly.  For  example,  a 
study  of  the  benefits  of  a  three-tank  over  a  two-tank  section  will  be 
dominated  by  increased  opportunities  versus  increased  cost.  Given  that 
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the  same  vulnerability  data  is  used  for  both  the  three  and  two-tank 
excursions,  the  precise  tank-vs-target  kill  data  will  have  little  influence 
on  the  relative  ranking  of  the  two  operational  concepts. 

On  the  other  hand,  insertion  of  an  entirely  new  opposing  tank  (or  an  old 
one  with  enhanced  armor)  may  make  a  qualitative  difference  in  a  study. 
In  any  case,  use  of  outdated  vulnerability/lethality  data  impugns  the 
results.  Thus,  timely  updating  of  the  vulnerability  database  and  efficient 
distribution  of  new  data  is  an  issue  of  importance  with  the  Armor  School. 

As  proponent  for  the  CCH  mission,  the  Directorate  for  Combat  Develop¬ 
ment  at  Ft.  Knox  is  involved  in  cost  and  operational  effectiveness  anal¬ 
yses  (COEAs).  Normally,  the  major  GOEAs  are  conducted  by  TRAC 
typically  took  one  year  from  initial  data  gathering.  This  was  an  am¬ 
ple  amount  of  time.  In  the  case  of  the  M1-A2  and  Block  3  studies, 
although  conducted  in  four  months,  the  data  lead  time  was  acceptable 
since  the  ASM  studies  had  already  been  in  progress.  However,  serious 
time-problems  did  occur  when  the  ASM  re-runs  were  mandated.  In  gen¬ 
eral,  Mr.  Vowels  appeared  most  understanding  about  the  need  for  time 
to  generate  vulnerability  data.  (“. . .  don’t  expect  10  day  turn-around  on 
a  new  concept”)  He  stressed  that  “DA  drives  the  train,  makes  decisions 
on  new  materiel  concepts.”  In  all,  there  were  no  complaints  about  the 
BRL  timeliness  in  this  area. 

Similarly,  there  were  no  complaints  about  the  completeness  and  compre¬ 
hensiveness  of  the  BRL/AMSAA  data.  Even  for  “what-if”  studies  (e.g. 
“What  if  the  engagement  opened  at  4  km  instead  of  3?”),  the  desired 
insights  can  generally  be  gained  by  selecting  ranges,  etc.  for  which  data 
already  exists. 

The  major  BRL/AMSAA  shortcomings  identified  by  Mr.  Vowels  dealt 
with  the  difficulties  he  has  encountered  in  finding  out  what  data  does 
exist  and  getting  access  to  that  data.  It  is  felt  that  AMSAA/BRL 
are  —  perhaps  understandably  —  over-protective  of  vulnerability  data. 
Ft.  Knox’  reliance  upon  TRAC-WSMR  for  data  has  come  about  largely 
because  of  the  difficulty  in  getting  data  through  AMSAA.  A  solution 
might  be  a  catalog  of  data  available,  similar  to  the  AMSAA  “Series  G” 
Handbook.  Mr.  Vowels  went  on  to  describe  possible  formats,  contents, 
etc. 

NOTE:  Although  BRL  data  is  clearly  involved,  these  comments  per¬ 
tained  more  directly  to  AMSAA  than  to  BRL  and  will  be  pursued 
through  other  avenues. 

The  final  concern  that  was  voiced  involved  consistency  within  a  database. 
This  area  is  fraught  with  problems  for  the  BRL.  For  example,  a  typi¬ 
cal  study  might  require  comparing  five  different  lQ5mm  rounds  against 
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target  X.  Unfortunately,  the  BRL  data  —  gathered  for  many  sources  — 
will  have  been  generated  over  a  several  years  and  may  have  used  sev¬ 
eral  different  methodologies  and  versions  of  target  X.  Often,  the  BRL 
gets  blamed  for  the  apparent  inconsistencies.  Mr.  Vowels  felt  that  the 
now  defunct  concept  of  “equivalent  RHA”  enhanced  comparability,  but 
realizes  the  inapplicability  to  new  armors  and  designs. 


2.  Conclusions 

Vulnerability  data  users  in  the  area  of  operational  planning  are  isolated 
from  the  BRL  by  intermediate  levels  of  data  manipulation,  in  particular 
the  conversion  of  vulnerability  data  to  Pj/Zi  -Pfc/a*  However,  some 
of  their  currently  unfulfilled  needs,  as  expressed  by  Mr.  Vowels,  might 
impact  indirectly  upon  the  BRL.  These  include  the  need  to  produce 
consistent  sets  of  data  to  support  COEAs  and  comparison  studies  and 
the  need  to  make  more  readily  available  catalogs  of  available  data. 

G.  Force-level  Models 

Force-level  simulations  in  the  Army  are  primarily  conducted  by  two  agen¬ 
cies:  the  TRADOC  Analysis  Command  (TRAC)  for  high  and  medium 
resolution  (Battalion  and  Corps/Division  level)  and  the  Concepts  Analy¬ 
sis  Agency  (CAA)  for  the  low  resolution  (Theater  level)  studies.  Within 
TRAC  there  are  several  agencies,  most  notably  TRAC-WSMR  (White 
Sands)  with  the  nominal  task  of  high  resolution  studies  and  TRAC-FTLV 
(Ft.  Leavenworth)  for  medium  resolution.  However,  a  third  agency, 
TRAC-RPD  (Ft.  Monroe)  coordinates  the  external  data  collection  for 
all  TRAC  agencies.  While  this  arrangement  adds  consistency  and  com¬ 
parability  among  studies  done  by  various  agencies,  it  also  adds  a  time 
and  management  burden. 

The  centralization  of  TRAC  data  collection  has  resulted  in  an  emphasis 
in  recent  years  on  the  use  of  data  which  has  been  “certified”  by  an  oflficial 
of  the  generating  agency.  Interpretations  of  this  requirement  may  place 
heavy  burdens  upon  data  generators.  For  example,  vulnerability  data 
for  a  particular  future  foreign  tank  may  be  available  from  a  previous 
project  and  usable,  with  caveats,  in  a  current  study.  However,  if  the 
onus  is  upon  the  AMC  to  certify  that  the  data  is  the  best  obtainable, 
a  re-run  may  be  necessary  to  take  advantage  of  the  latest  intelligence 
information.  In  response,  the  AMC  has  insisted  upon  having  an  early 
look  at  the  plans  for  upcoming  studies  in  order  to  schedule  timely  data 
generation  and  certification  of  the  required  data. 
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Generally,  the  time  scheduled  for  a  major  study  is  in  the  order  of  a 
year.  Of  that  time,  several  months  are  commonly  spent  in  study  man¬ 
agement:  planning  the  study,  getting  plan  approvals,  quantifying  objec¬ 
tives,  recruiting  participants,  etc.  That  leaves  one  to  four  months  for 
data  gathering. 

In  order  to  efficiently  supply  well  correlated,  certified  vulnerability /lethality 
data  ,  the  AMC  —  the  source  of  such  data  —  identified  the  AMSAA 
as  its  single  point  of  contact  for  studies  data.  The  POC  for  such  data 
is  Mr.  Don  Blanton,  who  therefore  represents  all  Force-level  users.  In 
turn,  Mr.  Blanton  “farms  out”  the  data  requests  to  the  BRL,  TACOM, 
AMSAA,  etc. 

It  is  generally  true  that  the  responsibility  for  specifying  required  data 
lies  with  the  study  proponent.  However,  the  AMSAA  POC  serves,  un¬ 
officially,  as  a  screen  for  requests,  making  sure  that  the  proponent  does 
not  ajsk  for  vast  amounts  of  unnecessary  data/detail  on  a  “just  in  case” 
basis. 

Finally,  as  expected,  there  is  an  inverse  relationship  between  the  size  of 
the  study  and  the  need  for  detail  in  the  data.  As  a  result,  the  broad  use 
of  surrogates  is  quite  acceptable  in  theater-level  studies,  which  require  a 
huge  number  of  weapon-target  pairings  (discussed  below). 

In  addition  to  Mr.  Blanton,  POCs  in  CAA  and  TRADOC  (Ft.  Knox) 
were  interviewed. 


1.  High  Resolution:  Battalion-level 

Conventional  weapon  data  for  battalion-level  simulations  consist  of  weapon- 
target  pairings.  For  direct  fire  weapons,  such  data  include  weapon  char¬ 
acteristics  and  accuracy  (from  AMSAA)  and  “lUA”  tables  from  the  BRL. 
(lUA  tables  contain  view-averaged  Pk  versus  exposure,  delivery  error, 
attack  angle  and  kill  criteria.)  For  indirect  fire  weapons,  BRL  generally 
supplies  vulnerable  areas  (Ay^)  to  AMSAA  which  uses  them  to  calculate 
mean  areas  of  effectiveness. 

The  typical  time  allotted  for  data  gathering  is  30  to  60,  occasionally  as 
much  as  90,  days.  The  number  of  weapons  is  limited  —  in  the  order  of 
10;  similarly,  the  number  of  targets  is  in  the  10s.  However,  very  little 
production  of  new  data  will  be  justified  by  the  time  and  money  budget 
of  a  study.  At  most,  old  data  may  be  tailored  to  fit  new  versions  of  old 
equipment,  retrofits,  etc.  The  primary  exception  may  be  the  study  item 
of  interest:  For  example,  in  a  simulation  to  evaluate  the  advantages  of  a 
new  tank,  that  tank  might  be  newly  modeled  in  detail. 
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However,  it  must  be  noted  that  battalion-level  models  can  involve  a  fair 
amount  of  detail.  For  example,  such  simulations  often  account  specifi¬ 
cally  for  the  aspect  angle  between  the  firer  and  the  target,  rather  than 
using  a  single  view-averaged  Pk.  The  benefit  of  this  practice  may  be 
questionable  if  the  data  file  itself  was  tailored  from  a  surrogate  by  the 
subjective  judgements  of  an  expert. 

Thus,  the  needs  of  the  high-resolution  model  can  be  summarized  as  100s 
of  firer-target  pairs  for  both  direct  and  indirect  fire  weapons  with  full 
detailed  output.  The  time  frame  for  gathering/generating  this  data  is 
30-60  days. 


2.  Medium  Resolution:  Corps/Division-level 

The  difficulties  encountered  in  the  medium  level  resolution  models  fall 
between  the  High  and  Low  resolution  and  will  thus  not  be  further  dis¬ 
cussed  here. 

3.  Low  Resolution:  Theater-level 

The  Army’s  center  of  expertise  in  theater-level  analysis  is  the  Concepts 
Analysis  Agency  (CAA).  POC  for  input  data  for  CAA  analyses  is  Mr. 
Greg  Andreozzi. 

In  short,  CAA  looks  to  AMSAA  for  all  its  data.  In  the  area  of  vul¬ 
nerability/lethality,  this  data  is  generally  in  the  form  of  single  shot  kill 
probabilities  (SSKPs),  lethal  areas  and  weapon  accuracies.  In  the  past, 
requests  for  data  have  been  generated  for  each  study;  however,  a  con¬ 
certed  effort  is  now  underway  to  generate,  in  advance,  requests  for  a 
year’s  worth  of  data.  This  procedure  should  help  the  supplying  agencies 
(AMSAA-BRL)  to  anticipate  and  better  schedule  data  production. 

In  fact,  data  sent  to  CAA  is  not  directly  used  in  theater-level  simula¬ 
tions.  Rather,  it  is  necessary  to  run  simulations  at  a  lower  (division) 
level  and  aggregate  various  division  results  into  a  theater  analysis.  The 
division  model  most  often  used  for  this  process  at  the  CAA  is  COSAGE, 
COSAGE  itself  is  only  resolved  down  to  battalions.  Thus,  data  on  in¬ 
dividual  shots  against  individual  targets  (for  example,  single  shot  kill 
probability  data)  is  highly  aggregated  before  entering  CAA  analyses, 
several  levels  below  the  final  outcome.  Needless  to  say,  details  in  the 
vulnerability  data  tend  to  get  “washed  out” . 

For  this  reason,  it  is  generally  acceptable  to  use  surrogate  weapons  and 
targets  in  supplying  AMSAA  with  data  that  will  be  sent  to  CAA.  How- 
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ever,  considering  all  the  possible  weapon- target- range  pairings  in  a  the¬ 
ater,  it  is  clear  that  the  volume  of  data  in  a  request  can  be  significant. 
The  major  methodological  need,  therefore,  is  for  an  efficient  system  of 
data  retrieval  and,  in  some  cases,  data  generation  using  previously  pre¬ 
pared  targets  and  weapon  characteristics  files. 


H.  COEA,  SSEB,  Ad  Hoc  Studies 

COEA,  SSEB,  Ad  Hoc  Studies  were  included  in  this  report  for  the  sake 
of  completeness.  In  fact,  analyses  of  this  type  generally  involve  a  coor¬ 
dinated  compilation  of  studies  of  the  types  discussed  above  (High-and 
Low-resolution  force-level  simulations,  “what-if”  studies,  and  so  forth.) 
Since  these  have  been  discussed  above,  no  further  discussion  is  necessary 
here. 


29 


IV.  Summary  and  Recommendations 


This  project  was  undertaken  to  establish  the  need  for  new  vulnerabil¬ 
ity  methodologies,  particularly  ones  which  would  not  fit  into  the  cur¬ 
rent  hierarchy  of  vulnerability  models.  The  approach  has  been  to  inter¬ 
view  users  of  vulnerability  data  at  all  levels  from  basic  equipment  design 
to  high-level  wargamers.  Several  dozen  individuals  representing  AMC, 
TRADOC,  CAA  and  their  contractors  were  interviewed. 

It  is  the  conclusion  of  this  study  that  no  fundamental  methodology  gap 
exists:  the  models  and  methodologies  extant  in  the  vulnerability  com¬ 
munity  span  the  range  of  needs  and  applications  found. 

However,  the  agencies  interviewed  did  bring  out  several  problems  which 
might  be  alleviated  by  improvements  in  the  existing  information,  in  the 
capabilities  of  the  methodologies  in  general  and  in  the  BRL  operating 
procedures. 


RECALL: 

The  purpose  of  this  article  is  to  report  the  results  of 
interviews  of  users  of  BRL-CAD  and  BRL  vulnerabil¬ 
ity/lethality  models  and  data.  The  presence  of  items 
on  the  following  list  does  NOT  indicate  a  BRL  conclu¬ 
sion  that  they  are,  in  fact,  true  deficiences  nor  that 
addressing  those  that  are  deficiencies  falls  within  the 
responsibility,  capability  or  best  interests  of  the  BRL. 

On  the  other  hand,  in  some  cases,  efforts  are  already 
underway  at  the  BRL  to  alleviate  some  of  the  prob¬ 
lems  listed  below.  Discussion  of  these  efforts  is  also 
beyond  the  scope  of  the  present  report. 

The  major  shortcomings  identified  by  the  users  were: 

•  Lack  of  a  useful  guide  to  vulnerability  practices.  Users  feel 
that  they  could  avoid  vulnerability  errors  early  in  the  development 
cycle  if  they  had  a  guide,  written  with  them  as  the  intended  audi¬ 
ence.  A  (computer-resident)  expert  system  was  a  suggested  alter¬ 
native.  Also,  the  possibility  of  having  a  vulnerability  expert  “on 
the  early  design  team”  was  another  suggestion. 

•  Need  for  extensions  to  current  simple  models  to  credit 
good  survivability  practices.  This  shortfall  was  brought  up  by 
an  agency  which  felt  that  evaluators,  such  as  TACOM,  may  be  inad¬ 
vertantly  suppressing  new  concepts  because  the  simple  evaluation 


tools  used  early  in  the  concept  evaluation  stage  do  not  credit  novel 
applications  of  good  vulnerability  reduction.  Similarly,  addition 
of  stochcistic  factors  into  simple  models  may  result  in  significantly 
more  realistic  outputs  for  little  additional  input. 

•  Lack  of  translators  between  BRL-CAD  and  other  CAD/CAM 
packages.  This  shortfall  came  up  often.  Note  that  the  program 
need  not  be  totally  automated,  nor  perfect  and  complete  at  the  first 
unveiling.  However,  it  must  be  very  user-oriented.  To  succeed,  such 

a  package  should  be  given  the  priority  and  investment  of  foresight, 
expertise  and  dedication  that  was  given  to  BRL-CAD  in  the  first 
place. 

As  a  related  note,  interviewees  involved  in  engineering  made  it  quite 
clear  to  the  author  that  the  design  and  engineering  agencies  that 
serve  the  US  Army  will  not  adopt  BRL-CAD  for  basic  engineering 
applications.  Thus,  the  existence  of  translators  which  would  make 
BRL-CAD  an  accepted  adjunct  to  a  firmly-entrenched  engineering 
methodology  is  definitely  in  the  interest  of  BRL-CAD. 

•  Need  for  a  comprehensive,  automated  data  renewal/data 
retrieval  system.  By  renewal  is  meant  a  means  of  re-doing  large 
numbers  of  calculations  to  reflect  changes  in  parameters.  This  is 
the  only  means  that  the  author  could  propose  to  solve  the  problems 
of  data  inconsistencies  which  were  the  most  prevalent  concern  at  all 
levels.  Ideally,  for  every  major  study,  the  study  team  could  come  to 
its  data  source  (ultimately,  the  BRL)  and  get  a  complete  package 
of  all  the  vulnerability  data  to  be  used,  freshly  generated  for  that 
study.  With  the  facilities  available  to  the  BRL,  this  may  be  a 
realizable  goal. 

•  Need  for  a  formal,  automated  and  defendable  procedure  for 
selecting  surrogates.  The  goal  is  to  reduce  the  subjectivity  that 
currently  surrounds  the  data  sent  for  use  in  large  simulations.  While 
the  subjectivity  may  never  be  wholly  removed,  the  use  of  a  formal, 
automated  procedure  offers  a  reasonable  guarantee  of  consistency 
and  removes  the  apparent  opportunity  for  injected  biases. 

•  Need  for  significant  enhancement  of  user-friendly  features. 

In  spite  of  the  remarkable  success  that  has  been  enjoyed  in  the 
spread  of  BRL-CAD,  many  users  do  not  consider  it  easy  to  use. 
Documentation  is  felt  to  be  very  obscure  and  unfriendly.  As  a  result, 
several  users  expressed  interest  in  user-oriented  enhancements. 

•  More  emphasis  on  methodology  maintenance.  In  particular, 
the  older  codes  that  still  play  an  important  role  in  vulnerability 
studies  (e.g.  VAST)  must  be  maintained  or  replaced.  It  is  under- 
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stood  that  MUVES  will  satisfy  all  the  methodological  needs  of  the 
vulnerability  community  and  that  older  models  will  be  allowed  to 
deteriorate.  However, 

—  MUVES  is  not  now  in  full  production  mode,  and 

—  even  when  MUVES  is  completed,  it  must  be  transitioned  into 
the  community  over  a  extended  period  of  time  during  which 
current  old  methodologies  will  still  be  in  use. 

The  conclusion  is  that  rudimentary  maintenance  of  the  old  method¬ 
ologies,  unpleasant  and  unfulfilling  as  it  may  seem,  must  be  done 
until  MUVES  is  in  place  and  running  in  a  significant  number  of  the 
influential  agencies.  Since  such  models  were  released  by  the 
BRL  without  promise  of  maintenance,  it  is  not  clear  that 
the  BRL  has  a  responsibility  to  provide  such.  However,  the 
BRL  should 

1.  expedite  the  development,  testing  and  distribution  of  a  new- 
generation  standard  suite  of  methodologies,  for  which  the  BRL 
will  assume  responsibility,  and 

2.  provide  reasonable  assistance  to  users  of  old  BRL  methodolo¬ 
gies  until  the  BRL  is  prepared  to  universally  distribute  replace¬ 
ments. 

In  addition,  four  specialized  requests  were  received. 

•  TACOM  would  like  to  be  able  to  rotate  the  turret  on  an  existing 
target  description.  This  would  require  some  significant  ingenuity  in 
designing  geometrical  constructs  that  can  stretch  and  change  shape 
in  order  to  model  wire  bundles,  etc.,  that  have  both  stationary  and 
rotating  portions. 

•  A  number  of  agencies  asked  about  the  possibility  of  generating  con¬ 
fidence  bounds  along  with  vulnerability  estimates.  Although  this 
information  would  have  little  direct  applicability  for  the  large-scale, 
low-resolution  users,  it  would  be  of  use  in  the  interpretation  of  re¬ 
sults  for  the  detailed  studies. 

•  The  BRL  is  often  sought  to  serve  as  the  “honest  broker”.  One 
manifestation  of  the  role  is  the  keeping  of  standard  libraries  of  pa¬ 
rameters,  such  as  penetration  efficiencies.  Another  is  acting  as  an 
arbiter  in  non-standard  cases.  In  fact,  the  BRL  often  provides  such 
services  while  serving  on  source  selection  boards  and  providing  sim¬ 
ilar  services  to  TACOM,  TRADOC,  etc.  Therefore,  this  request  can 
be  taken  as  a  formal  recognition  of  the  importance  of  such  service. 
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•  Finally,  the  BRL  wa5  asked  to  assist  AMSAA  should  it  be  convinced 
to  develop  a  catalog  of  available  vulnerability  data.  Data  requesters 
indicated  that  they  would  tailor  their  requests  to  take  adv2nitage 
of  available  data  —  especially  if  the  requester  would  gain  quicker 
response  to  his  requests.  However,  the  requesters  generally  do  not 
know  what  data  is  available  for  fast  delivery. 

At  the  risk  of  setting  up  yet  another  bureaucracy,  it  was  suggested  that 
the  VLD  might  profit  from  establishing  a  single  point-of*contact,  a  few 
person  office  that  would  function  as  a  “factory  expediter,  inventory  con¬ 
troller  and  shipping  department”.  Such  an  office  would  also  be  in  a 
position  to  keep  track  of  what  analyses  are  in  progress,  thus  helping  to 
avoid  the  wasted  duplication  of  effort  that  can  result  from  independent 
requests  to  different  branches. 

In  summary,  the  users  of  VLD  data  are  generally  satisfied  with  the 
methodologies  employed.  Requested  improvements  lie  mostly  in  the  op¬ 
erating  procedures  and  the  available  user-oriented  facilities. 

Finally,  repeating  the  major  conclusion  stated  above: 

It  is  the  conclusion  of  this  study  that  no  fundamental 
methodology  gap  exists:  the  models  and  methodolo¬ 
gies  extant  in  the  vulnerability  community  span  the 
range  of  needs  and  applications  found. 
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Appendix  A 

Test  Prediction/Postdiction 
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1.  Introduction 


The  Vulnerability  Methodology  Branch  (VMB)  of  the  BRL  has  been 
one  of  the  most  active  DoD  agencies  in  the  area  of  live-hre  predic¬ 
tion/postdiction,  both  in  the  development  of  statistically  sound  tech¬ 
niques  and  in  the  application  of  these  techniques  to  extensive,  high- 
visibility  tests.  In  particular,  the  VMB  developed  the  SQuASH  (Stochas¬ 
tic  Quantitative  Analysis  of  System  Hierarchies)  Methodology  in  which 
precise  hit  point,  warhead  performance,  residual  penetrator  deflection, 
spall  production  and  component  P/v/h  are  stochastically  varied.  Through 
this  technique,  the  methodology  is  able  to  predict  probabilistic  distribu¬ 
tions  of  results  —  the  only  appropriate  metric  for  a  process  as  unpre¬ 
dictable  as  a  live-fire  vulnerability  test. 

In  a  recent  report  Deitz  and  Ozolins  listed  their  observations  on  model 
calibration  and  the  live-fire  objectives.  These  are  reproduced  in  the 
following  subsection. 


2.  Observations  from  BRL-MR-3755 

a.  Model  Calibration  Given  the  complexity  of  the  vulnerability 
process  revealed  at  this  level  of  detail,  it  is  anticipated  that  model  cal¬ 
ibration  may  prove  exceedingly  difficult.  Particularly  because  many  of 
the  inputs  to  the  model  (i.e.  penetration,  BAD  and  component-damage 
algorithms)  are  poorly  hnown.  For  the  modelers  at  BRL,  one  of  the  key 
issues  in  the  next  phase  of  analysis  is  to  compare  the  code  predictions 
with  the  single  outcomes  of  the  field  tests.  Of  great  importance  is  to 
find  what  possible  damage  mechanisms  may  be  evidenced  that  are  not 
handled  in  the  current  code  realization. 

A  related  issue  is  the  “validation’’'^  of  vulnerability  models.  There  have 
been  attempts  to  apply  statistical  tests  to  compai’e  Live  Fire  LOFs  with 
model  predictions  in  order  to  judge  the  goodness  of  agreement.''  ®  This 

^P.  H.  Deitz  and  A.  Ozolins,  Compvter  simulaiions  of  the  Abrams  Live-Fire  Field  Testing, 
BRL  Report  BRL-MR-3755,  May  1989 

tValidation  is  a  word  that  should  surely  be  struck  from  the  DoD  lexicon.  For  more  than 
a  century,  researchers  have  recognized  that  experiments  don’t  prove  theory,  they  can  only 
disprove  it. 

“^Paul  II.  Deitz,  Jill  H.  Smith  and  John  H.  Suckling,  Comparisons  of  Field  Tests  with 
Simulations:  Abrams  Program  Lessons  Learned,  Proceedings  of  the  XXVIII  Annual  Meeting 
of  the  Army  Operations  Research  Symposium,  11-12  October,  1989,  Ft.  Lee,  VA;  also. 
Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3814,  March  1990 

®Paul  H.  Deitz,  Michael  W.  Starks,  Jill  H.  Smith  and  Aivars  Ozolins,  Current  Simulation 
Methods  in  Military  Systems  Vulnerability  Assessment,  Proceedings  of  the  XXIX  Annual 
Meeting  of  the  Army  Operations  Research  Symposium,  10-11  October,  1990,  Ft.  Lee,  VA; 
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has  been  problematic  for  a  number  of  reasons;  first,  as  we  have  seen 
above,  the  LOF  metrics  are  non-para, metric  (although  that  fact  wasn’t 
known  until  this  work).  Thus  any  method  which  depends  on  outcomes 
being  Gaussian  distributed  is  inapplicable.  Second,  it  is  clearly  imprac¬ 
tical  to  derive  LOF  probability  density  functions  from  field  tests,  and 
until  now,  no  model  was  capable  of  producing  an  estimate. 

b.  Penetration  &:  BAD  Data  Emphasized  throughout  this  paper 
has  been  the  need  for  reliable  data  describing  the  overmatch  phenomena 
for  warhead/armor  interactions.  Full-up  live-fire  events  are  not  the  place 
to  gather  this  data  since  they  do  not  provide  calibrated  diagnostic  media 
to  capture  such  data.  Further,  since  the  most  central  phenomena  in  the 
vulnerability  process  are  themselves  often  known  poorly,  it  becomes  all 
the  more  difficult  in  the  post-test  assessment  to  separate  out  the  primary 
damage  phenomenologies  from  those  that  are  secondary. 

c.  Limitations  of  Component  PKs  The  basic  element  for  assess¬ 
ing  component  dysfunction  is  through  component  PK  characterization. 
Much  “off-line”  testing  of  specific  systems  needs  to  be  accomplished  to 
generate  an  adequate  data  base.  Even  if  the  interaction  of  single  frag¬ 
ments  with  components  becomes  better  understood,  the  problem  of  mul¬ 
tiple  fragments  must  be  put  on  a  firmer  foundation. 

d.  Secondary  Kill  Phenomena  .4s  noted  earlier,  it  is  anticipated 
that  the  analysis  of  the  Abrams  LF  test  data  will  provide  valuable  insight 
into  the  importance  of  this  class  of  da.ma.ge  mechanisms. 


e.  Damage  Synergism  Tf  and  as  other  damage  mechanisms  are  rec¬ 
ognized  to  be  important  in  this  context  and  can  be  modeled,  a  further 
significant  issue  will  then  arise.  Just  as  the  multiple-fragment  interac¬ 
tion  with  a  single  component  is  modeled  in  an  unsatisfactory  fashion, 
there  are  no  extant  algorithms  for  aggregating  damage  to  a  single  com¬ 
ponent  from  multiple  phenomenologies.  For  example  if  it  were  possible 
to  model  both  shock  and  fragment  interaction  individually  with  a  given 
component,  there  is  no  known  method  for  combining  the  individual  kill 
assessments. 


also,  Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3814,  In  Press. 


f.  Aggregation  of  Loss-of-Component  Effects  As  noted  above, 
deactivation  diagrams  are  the  means  by  which  individual  component 
loss  is  aggregated  up  to  the  major  system  or  sub-system  level.  This 
artifice  needs  to  be  examined  more  thoroughly  both  to  learn  whether 
this  procedure  is  reliable  in  general  and  further  whether  the  intrinsic 
subjectivity  of  the  process  when  applied  to  a  particular  system  leads  to 
inappropriate  biases. 

g.  System  Damage  to  MOEs  The  historical  method  for  accom¬ 
plishing  this  task  is  via  the  Standard  Damage  Assessment  List.  This 
process  is  in  dire  need  of  replacement,  and  work  to  define  alternative 
approaches  is  ongoing.  Taking  this  procedure  as  a  given,  however,  it  is 
cleaj'  that  typical  system  damage  is  very  complex,  and  PK  histograms 
ill-behaved.  Certainly  comparing  a  single  test  PK  with  the  first  moment 
of  the  associated  probability  density  function  is  useless.  Even  showing 
that  the  field  PK  is  coincident  with  a  single  PK  in  the  predicted  PK  his¬ 
togram  is  ii'relevant  because  entirely  different  damage  states  can  map  to 
the  same  point  in  PK  outcome  space. 

h.  “Objective”  (Field-Based)  PKs  From  Section  IV,  the  steps 
involved  in  deriving  final  PK  values,  whether  from  actual  field  shots  or 
computer  simulation.s,  should  be  clear.  A  particular  field  shot  corre¬ 
sponds  to  a  single  mapping  from  Space  1]  to  Space  2)  {This  refers  to  a 
figure  in  the  original  document.  Spaces  1  through  4  refer  to: 

1.  Warhead/Target  Interaction 

2.  Component  Damage  State(s) 

3.  Measures  of  Performance 

4.  Measures  of  Effectiveness 

That  same  mapping,  or  transformation  process,  is  simulated  in  the  SQuASH 
code.  However,  it  is  critical  to  note  that  the  step  from  Space  2]  to  Space 
4],  where  the  final  PK  or  LOP  value  is  derived,  follows  the  identical 
transformation  process  whether  the  damage  state  is  “real”  or  computer 
simulated.  Although  it  ma.y  be  argued  that  the  assessment  of  post-shot 
damage  (in  Space  2])  is  an  objective  process,  the  criticality  analysis® 

®J.  J.  Ploskonka,  T.  M.  Muehl,  C.  J.  Dively,  “Criticality  Analysis  of  the  MlAl  Tank”, 
Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3671,  June  1988- 
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and  SDAL  artifice^  ® 

at  the  heart  of  the  Space  2]  to  Space  4]  mapping  are  highly  subjective 
in  nature.  Thus  even  field  data  must  undergo  this  somewhat  arbitrary 
transformation.  Further,  if  meaningful  comparisons  of  field  data  and 
simulations  are  to  be  made,  then  the  identical  mapping  process  must  be 
used  for  both  sets  of  data.  There  have  been  instances  in  which  field 
assessors  have  examined  a  vehicle  following  a  live-fire  test,  made  certain 
subjective  conclusions  about  the  level  of  damage,  and  then  intuited  a 
“PK”  without  regard  to  either  the  precise  logic  of  the  criticality  analysis 
or  the  SDAL  process.  Clearly  if  this  approach  were  to  be  utilized,  there 
would  be  no  hope  of  rationalizing  field  measurements  with  predictions. 

i.  Value  of  Full-Up  Testing  It  is  clear-  that  even  if  all  possible  off¬ 
line  tests  were  performed,  the  phenomena  understood,  and  the  related 
data  bases  established,  there  are  other  significant  effects  that  can  only 
be  tested  in  a  full-up  configuration.  Included  in  this  category  are  blast 
and  shock  phenomena  and  ricochet,  for  example. 

However  from  the  modeler’s  perspective,  the  order  of  Live-Fire  test¬ 
ing  was  initiated  in  a  backward  order.  For  example,  the  BRL  has  had 
to  make  preshot  predictions  for  the  Abrams  program  before  any  frag¬ 
ment/component  firings  have  taken  place.  Although  the  test  plan  should 
be  formulated  in  a  top  down  fashion,  the  implementation  should  occur  in 
a  bottom  up  sequence.  This  is  distinctly  not  the  actual  order  of  events. 

j.  Live-Fire  Testing  The  Live-Fire  program,  not  only  for  the  Abrams 
but  other  military  vehicles,  will  unquestionably  improve  the  quantity  and 
quality  of  data  with  which  modelers  can  make  more  reliable  assessments. 
However  from  the  complexities  of  the  vulnerability  process  evident  even 
now  with  the  new  class  of  stochastic  modeling  via  the  SQuASH  model,  it 
is  clear  that  statistical  limitations  will  preclude  any  kind  of  rigorous  val¬ 
idation.  The  best  that  can  be  expected  will  be  that  some  uncertainties 
in  the  process  will  be  subject  to  quantitative  assessment. 

^G.A.  Zeller,  “Update  of  the  Standard  Damage  Assessment  List  (SDAL)  for  Tanks”, 
Executive  Summary,  ASI  Systems  International  Report  87-14,  October  1987. 

®G.  A.  Zeller  and  B.  F.  Armendt,  “Update  of  the  Standard  Damage  Assessment  List 
for  Tanks:  Underlying  Philosophy  and  Final  Results”,  Submunition  Evaluation  Program, 
Project  Chicken  Little,  Report  AD-TR-65,  November  1987. 
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3.  Summary 

From  the  above  observations  and  private  discussions,  it  appears  that 
the  major  remaining  methodological  shortcomings  are  not  in  the  overall 
vulnerability  model  (SQuASH),  but  with  the  data  and  algorithms  that 
are  embodied  in  the  model.  As  discussed  above,  these  include: 

•  Penetration  and  BAD  data 

•  Component  P^ 

•  “Secondary”  Kill  Phenomena 

•  Damage  Synergism 

•  Aggregation  of  Loss-of-Component  Effects 

•  Relating  System  Damage  to  Mission  Degradation 

In  addition,  it  is  important  to  question  the  fundamental  assumption  that 
the  defeat  of  a  target  can  be  expressed  in  terms  of  the  defeat  of  individ¬ 
ual  components.  Tests  to  date  have  tended  to  confirm  this  assumption. 
However,  indirect  effects  from  individual  components  (e.g.  a  fire  from 
a  non-critical  component  which  damages  a  critical  one)  must  be  artifi¬ 
cially  injected.  At  present,  there  is  no  general  methodology  to  predict 
indirect  effects:  such  effects  are  included  in  an  analysis,  through  expert 
judgement,  by  assigning  “false  criticality”  to  the  potentially  dangerous 
component. 
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ATTN:  AMSTA-NKS  (D.  Cyaye) 

(J.  Rowe) 

Warren,  MI  48397-5000 

2  Commander 

U.S.  Army  Tank-Automotive  Command 
ATTN:  AMSTA-RG  (R.  Munt) 

(R.  McClelland) 

Warren,  MI  48397-5000 

2  Commander 

U.S.  Army  Tank- Automotive  Command 
ATTN:  AMSTA-RSC  (John  Bennett) 
(Wally  Mick) 

Warren,  MI  48397-5000 

1  Commander 

U.S.  Army  Tank- Automotive  Command 
ATTN:  AMSTA-RSK  (Sam  Goodman) 
Warren,  MI  48090-5000 

1  Commander 

U.S.  Army  Tank- Automotive  Command 
ATTN:  AMSTA-RY  (Ron  Beck) 
Warren,  MI  48090-5000 

6  Commander 

U.S.  Army  Tank-Automotive  Command 
ATTN:  AMSTA-ZE  (R.  Asoklis) 

AMSTA-ZEA  (C.  Robinson) 

(R.  Gonzalez) 
AMSTA-ZS  (D,  Rees) 
AMSTA-ZSS  (J.  Thompson) 

(J.  Soltez) 

Warren,  MI  48397-5000 
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1  Office  of  the  PEO,  Armored  Sys  Mod 

ATTN:  SFAE-ASM-CV  (Brian  Bonkosky) 
Warren,  MI  48397-5000 

1  Commander 
HQ,  TRADOC 

ATTN:  Asst  Dep  Chief  of  Staff 
for  Combat  Operations 
Fort  Monroe,  VA  23651-5000 

2  Director 

HQ,  TRAC  RPD 

ATTN:  ATRC-RP  (COL  Brinkley) 

ATRC-RPR  (Mark  W.  Murray) 

Ft.  Monroe,  VA  23651-5143 

1  Director 

U.S.  Army  Cold  Regions  Research  and 
Development  Laboratory 
ATTN:  Technical  Director  (Lewis  Link) 

72  Lyme  Road 
Hanover,  NH  03755 

1  U.S.  Army  Corps  of  Engineers 

Assistant  Director  Research  and  Development 
Directorate 
ATTN:  Mr.  B.  Benn 
20  Massachusetts  Avenue,  NW 
Washington,  DC  20314-1000 

1  Commander 

U.S.  Array  Operational  Test  and  Evaluation 
Agency 

ATTN:  MG  Stephenson 
4501  Ford  Avenue 
Alexandria,  VA  22302-1458 

1  Commander 

U.S.  Array  Vulnerability  Assessment 
Laboratory 

ATTN:  SLCVA-CF  (Gil  Apodaca) 

White  Sands  Missile  Range,  NM  88002-5513 

1  Director 

TRAC-WSMR 

ATTN:  ATRC-RD  (McCoy) 

WSMR,  NM  88002-5502 


2  U.S.  General  Accounting  Office 
Program  Evaluation  and  Methodology 

Division 

ATTN:  Robert  G.  Orwin 
Joseph  Sonnefeld 
Room  5844 
441  G  Street,  NW 
Washington,  DC  20548 

1  Director 

U.S.  Army  Model  Improvement  and  Study 
Management  Agency 
ATTN;  SFUS-MIS  (Eugene  P.  Visco) 

1900  Half  Street,  SW,  Rm  LlOl 
Washington,  DC  20324 

1  Director 

U.S.  Army  Industrial  Base  Engineering 
Activity 

ATTN:  AMXIB-MT 
Rock  Island,  IL  61299-7260 

1  Director 

U.S.  Army  Industrial  Base  Engineering 
Activity 

ATTN:  AMXIB-PS  (Steve  McGlone) 

Rock  Island,  IL  61299*7260 

3  Director 

U.S.  Army  Engineer  Waterways  Experiment 
Station 

ATTN:  WESEN  (Dr.  V,  LaGarde) 

(Mr.  W.  Grabau) 

WESEN-C  (Mr.  David  Meeker) 

PO  Box  631 

Vicksburg,  MS  39180-0631 

1  U.S.  Army  Engineer  Topographic 
Laboratories 

ATTN:  Technical  Director  (W.  Boge) 

Fort  Belvoir,  VA  22060-5546 

1  Commander 

U.S.  Army  Operational  Test  and  Evaluation 
Agency 

ATTN;  LTC  Gordon  Crupper 
4501  Ford  Ave.  #870 
Alexandria,  VA  22302-1435 
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1  Commander 

David  Taylor  Research  Center 
Code  1702  (Mr.  Robert  Wunderlick) 
Bethesda,  MD  20084-5000 

1  Commander 

David  Taylor  Research  Center 
Code  1740.2  (Mr.  Fred  J.  Fisch) 

Bethesda,  MD  20084-5000 

1  Commander 

David  Taylor  Research  Center 
Code  1750  (Mr.  William  Conley) 

Bethesda,  20084-5000 

1  Director 

Lawrence  Livermore  National  Laboratory 
ATTN:  Mark  Wilkins  (L-3321) 

PC  Box  808 
Livermore,  CA  94551 

3  Director 

Los  Alamos  National  Laboratory 
ATTN:  Dean  C.  Nelson,  MS  985 
Gary  Tietgen,  MS  F600 
Terrence  Phillips,  MS  G787 
PO  Box  1663 
Los  Alamos,  NM  87545 

1  Director 

Los  Alamos  National  Laboratory 

ATTN:  LTC  Michael  V.  Ziehmn,  MS  F681 

USMC 

PO  Box  1668 

Los  Alamos,  NM  87545 

1  Director 

Sandia  National  Laboratories 
Department  913 
ATTN:  Ron  Andreas 
Albuquerque,  NM  87185-5800 

1  Director 

Sandia  National  Laboratories 
Division  1611 
ATTN:  Tom  James 
Albuquerque,  NM  87185 


1  Director 

Sandia  National  Laboratories 
Division  1623 
ATTN:  Larry  Hostetler 
Albuquerque,  NM  87185 

1  Director 

Sandia  National  Laboratories 
ATTN:  Gary  W.  Richter 
PO  Box  969 
Livermore,  CA  94550 

1  Commander 

Naval  Air  Systems  Command 
JTCG/AS  Central  Office 
ATTN:  5164J  (LTC  James  B.  Sebolka) 
Washington,  DC  20361 

1  Commander 

ADR  Program  Manager 
CODE  AIR'41112I 
ATTN:  Tom  Furlough 
Nava!  Air  Systems  Command 
Washington,  DC  20361-4110 

1  Commander 

Naval  Ocean  Systems  Center 
ATTN:  Earle  G.  Schweizer 
Code  000 

San  Diego,  CA  92151-5000 

5  Commander 

Naval  Surface  Warfare  Center 
ATTN:  Gregory  J.  Budd 
James  Ellis 
Barbara  J.  Harris 
Constance  P.  Rollins 
Tom  Wasmund 
Code  G13 

Dahlgren,  VA  22448-5000 

1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  Glen  Hornbaker 
Code  G102 

Dahlgren,  VA  22448-5000 


No.  of 
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1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  George  Williams 
Code  J33 

Dahlgren,  VA  22448-5000 

1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  Frank  Fassnacht 
10901  New  Hampshire  Ave. 
Code  N15 

Silver  Spring,  MD  20903-5000 

1  Commander 

Naval  Surface  Warfare  Center 
ATTN;  Norma  D.  Holland 
Code  R-14 

Silver  Spring,  Md  20903-5000 

1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  Dr.  F.E.  Baker 
10901  New  Hampshire  Ave. 
Silver  Spring,  MD  20903-5000 


1  Commander 

U.S.  Naval  Weapons  Center 
ATTN;  David  H.  Hall  (Code  3181) 
China  Lake,  CA  93555-6001 

1  Commander 

U.S.  Naval  Weapons  Center 

ATTN;  Mark  D.  Alexander  (Code  3894) 

China  Lake,  CA  93556-6001 

1  Commander 

U.S.  Naval  Weapons  Center 
ATTN:  Melvin  H.  Keith  (Code  35101) 
China  Lake,  CA  93555-6001 

1  Commander 

U.S.  Naval  Weapons  Center 
ATTN:  Tim  Horton  (Code  3386) 

China  Lake,  CA  93555-6001 

1  Commander 

U.S.  Naval  Weapons  Center 
ATTN;  Robert  Cox,  Code  3517 
China  Lake,  CA  93555-6001 


1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  William  Emberson 
Code  H021 

10901  New  Hampshire  Avenue 
Silver  Spring,  MD  20903-5000 

1  Commander 

Naval  Surface  Warfare  Center 
ATTN:  M.  John  Timo 
10509  Edgefield  Drive 
Adelphi,  MD  20783-1130 

2  Commander 

U.S.  Naval  Weapons  Center 
ATTN;  Jay  Butterworth 
Dr.  Helen  Wang 
Code  3951 

Bldg  1400,  Room  B20 
China  Lake,  CA  93555-6001 


1  Commander 

U.S.  Naval  Civil  Eng  Laboratories 
ATTN:  John  M.  Ferritto  (Code  L53) 
Port  Hueneme,  CA  93043 

1  Naval  Postgraduate  School 

ATTN:  Professor  Robert  E.  Ball 
Department  of  Aeronautics 
and  Astronautics 
Monterey,  CA  93943 

1  Naval  Postgraduate  School 
ATTN:  Dr.  Michael  J.  Zyda 
Department  of  Computer  Science 
Code  52 

Monterey,  CA  93943-5000 

1  Naval  Postgraduate  School 

Department  of  National  Security 
ATTN:  Dr.  Joseph  Sternberg 
Code  73 

Monterey,  CA  93943 
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1  Commander 

Naval  Air  Systems  Command 
ATTN:  Mr.  Philip  Weinberg 
Code  AIR-516  J 
Washington,  DC  20361-5160 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  William  G.  Boyce 
Code  56Y52 
Washington,  DC  20362 

1  Commander 

Naval  Sea  Systems  Command 
ATTN;  Granville  W.  Broome 
SEA  5011 

2521  Jefferson  Davis  Hwy. 
Arlington,  VA  22202 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  Philip  M.  Covich 
SEA  55X 

Washington,  DC  20362-5101 

2  Commander 

Naval  Sea  Systems  Command 
ATTN:  CPT  Charles  Calvano  USN 
Robert  Keane,  Jr. 

SEA  50 

Washington,  DC  20362-5101 


1  Commander 

Naval  Sea  Systems  Command 
ATTN:  Larrie  D.  Ferreiro 
SEA  501 

2521  Jefferson  Davis  Hwy, 

Arlington,  VA  22202 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  Anthony  F.  Johnson 
SEA  05R2 

Washington,  DC  20362-5101 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  CPT  William  E.  Mabew  USN 
PMS  423 

Washington,  DC  20362-5101 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  CarlH.  Pohler 
Code  05R23 

Washington,  DC  20362-5101 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  Ronald  P.  Kramer 
SEA  50143 

2521  Jefferson  Davis  Hwy. 

Arlington,  VA  22202 


1  Commander 

Naval  Sea  Systems  Command 
ATTN;  Oliver  F.  Braxton 
2521  Jefferson  Davis  Hwy. 
Arlington,  VA  22202 

1  Commander 

Naval  Sea  Systems  Command 
ATTN:  Donald  Ewing 
Code  503 

2521  Jefferson  Davis  Hwy. 
Arlington,  VA  22202 


1  Commander 

Naval  Sea  Systems  Command 
ATTN:  CPT  R.  Percival  USN 
SEA  05T 

2521  Jefferson  Davis  Hwy. 
Arlington,  VA  22202 


1 


Commander 

Space  and  Naval  Warfare  Systems  Command 
ATTN:  Paul  Wessel 
Code  SOT 

Washington,  DC  20363-5100 


52 


No.  of 
Copies 


No.  of 
Copies 


* 


1  Commander 

Intelligence  Threat  Analysis  Center 
ATTN;  PSD-GAS/John  Bickle 
Washington  Navy  Yard 
Washington,  DC  20374 

1  Commander 

Intelligence  Threat  Analysis  Center 
ATTN:  Ron  Demeter 
Washington  Navy  Yard,  B-213,  Stop  314 
Washington,  DC  20374 

1  Commander 

Intelligence  Threat  Analysis  Center 
ATTN:  Tim  Finnegan 
Washington  Navy  Yard,  B-213 
Washington,  DC  20374 

2  Commander 

David  W.  Taylor  Naval  Ship  and 
Development  Center 
ATTN;  W.  Conley 
J.  Schot 

Bethesda,  MD  20084 

1  Office  of  Naval  Technology 
ATTN;  David  J.  Siegel 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 

1  Commander 

Eglin  Air  Force  Base 
AD/ENL 

ATTN:  Robert  L.  Stovall 
Eglin  AFB.FL  32542 

1  Commander 

USAF  HQ  ESD/PLEA 
Chief,  Engineering  and  Test  Division 
ATTN:  Paul  T.  Courtoglous 
Hanscom  AFB,  MA  01730 

2  Commander 
AFATL 

ATTN:  AGA  (Lawrence  Jones) 

(Mickie  Phipps) 

Eglin  AFB,  FL  32542-5434 


1  WL/MNMW  (Mr.  John  A.  Collins) 

Eglin  AFB,  FL  32542 

1  Commander 
AFEWC 

ATTN:  AFEWC/SAXE  (Bod  Eddy) 
Kelly  AFB,  TX  78243-5000 

1  Commander 
AFWAL/AARA 
ATTN:  Ed  Zelano 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
AFWAL/FIES 

ATTN;  James  Hodges  Sr. 
Wright-Patterson  AFB,  OH  45433-6523 

2  Commander 
AFWAL/MLTC 

ATTN:  LT  Robert  Carringer 
Dave  Judson 

Wright-Patterson  AFB,  OH  45433-6533 

1  Commander 
ASB/XRM 

ATTN:  Gerald  Bennett 
Martin  Lentz 

Wright-Patterson  AFB,  OH  45433 

1  Commander 
WRDC/AARA 
ATTN:  Michael  L.  Bryant 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
FTD/SDMBA 
ATTN:  Charles  Darnell 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
FTD/SDMBU 
ATTN:  Kevin  Nelson 
Wright-Patterson  AFB,  OH  45433 


1  Commander 
FTD/SQDRA 
ATTN:  Greg  Koesters 
Wright-Patterson  AFB,  OH  45433-6508 
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1  Commander 
FTD 

ATTN:  Tom  Reinhardt 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
FTD/SDAEA 
ATTN:  Joe  Sugrue 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
AFWAL/AARA 
ATTN:  Vincent  Velten 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
FTD/SQDRA 
ATTN:  Larry  E.  Wright 
Wright-Patterson  AFB,  OH  45433 

1  Commander 
AD/CZL 

ATTN:  James  M.  Heard 
EglinAFB,  FL  32542-5000 

1  Commander 

AD/ENY 

ATTN:  Dr.  Stewart  W.  Turner 
Director  of  Engineering  Analysis 
EglinAFB,  FL  32542-5000 

2  Commander 
AD/ENYW 

ATTN:  2LT  Michael  Ferguson 
Jim  Richardson 
EglinAFB,  FL  32542-6000 

1  Commander 

Air  Force  Armament  Laboratory 
ATTN;  AFATL/DLY  (James  B.  Flint) 
EglinAFB,  FL  32542-5000 

1  Commander 

U.S.  Army  FSTC/CA3 
ATTN:  Scott  Mingledorff 
220  Seventh  Avenue 
Charlottesville,  VA  22901-5396 


No.  of 

Copies  Organization 

1  Commander 

U.S.  Army  FSTC  (UK) 

ATTN:  MAJ  Nigel  Williams 
220  Seventh  Avenue 
Charlottesville,  VA  22901-5396 

1  Commander 

U.S.  Army  FSTC 
ATTN:  Dr.  Tim  Small 
220  Seventh  Avenue 
Charlottsville,  VA  22901-5396 

1  Defense  Intelligence  Agency 
ATTN:  DB-6E3  (Jay  Hagler) 
Washington,  DC  20340-6763 

5  Institute  for  Defense  Analyses  (IDA) 
ATTN:  Mr.  Irwin  A.  Kaufman 
Mr.  Arthur  O.  Kresse 
Dr.  Lowell  Tonnessen 
Mr.  Benjamin  W.  Turner 
Ms.  Sylvia  L.  Waller 
1801  N.  Beauregard  Street 
Alexandria,  VA  22311 

1  Institute  for  Defense  Analyses 
ATTN:  Carl  F.  Kossack 
1005  Athens  Way 
Sun  City,  FL  33570 

1  Institute  for  Defense  Analyses 

ATTN:  Dr.  Natarajan  Subramonian 
14309  Hollyhock  Way 
Burtonsville,  MD  20866 

1  Department  of  Commerce 

National  Institute  of  Standards  and 
Technology 

Manufacturing  Systems  Group 
ATTN:  B.  Smith 
Washington,  DC  20234 

1  AAI  Corporation 

ATTN:  H.  W.  Schuette 
PO  Box  126 

Hunt  Valley,  MD  21030-0126 
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2  ADPA 

ATTN;  Donna  R.  Alexander 
Bill  King 

Two  Colonial  Place,  Suite  400 
2101  Wilson  Boulevard 
Arlington,  VA  22201-3061 

1  ARC  Professional  Services  Group 
ATTN:  Arnold  R.  Gritzke 
5501  Backlick  Road 
Springfield,  VA  22151 

2  Advanced  Marine  Enterprises 
ATTN;  James  F.  Hess 

CPT  Frederic  S.  Hering  USN  (Ret) 
1725  Jefferson  Davis  Highway 
Suite  1300 

Arlington,  VA  22202 

1  The  Armed  Forces  Communications  and 

Electronics  Association 
ATTN:  Kirby  Lamar,  BG(Ret) 

4400  F air  Lakes  Court 
Fairfax,  VA  22033-3899 

2  Aero  Corporation 
ATTN;  David  S.  Eccles 

Gregg  Snyder 
P.O.  Box  92957,  M4/913 
Los  Angeles,  CA  90009 

1  AFELM,  The  Rand  Corporation 
ATTN:  Library-D 

1700  Main  Street 
Santa  Monica,  CA  90406 

2  Air  Force  Wright  Aeronautical  Labs 
ATTN:  CDJ,  CPTJost 

CD  J,  Joseph  F aison 

Wright-Patterson  AFB,  OH  45433-6523 

1  Alliant  Techsystems,  Inc. 

ATTN:  Hatem  Nasr 
Systems  and  Research  Center 
3660  Technology  Drive 
P.O.  Box  1361 
Minneapolis,  MN  55418 


1  Alliant  Techsystems,  Inc. 

ATTN:  Fred  J.  Parduhn 
7225  Northland  Drive 
Brooklyn  Park,  MN  55428 

2  Alliant  Techsystems,  Inc. 

ATTN:  Raymond  H.  Burg 

Laura  C.  Dillway 
MN38-4000 

10400  Yellow  Circle  Drive 
Minnetonka,  MN  55343 

1  Allison  Gas  Turbine 
Division  of  GM 
ATTN:  Michael  Swift 
PC  Box  420,  SC  S22B 
Indianapolis,  IN  46260*0420 

1  Aluminum  Company  of  America 
ATTN:  Frank  W.  Baker 
Alcoa  Technical  Center 
Alcoa  Center,  PA  15069 

1  Analysis  and  Technology 

ATTN:  RADM  Thomas  M.  Hopkins  USN 
(Ret) 

1113  Carper  Street 
McLean,  VA  22101 

1  ANSER 

ATTN:  James  W.  McNulty 
1215  Jefferson  Davis  Highway 
Arlington,  VA  22202 

1  ARC  C-500 

ATTN:  John  H.  Bucher 
Modena  Road 
Coatesville,  PA  19320 

1  Armament  Systems,  Inc, 

ATTN:  Gerard  Zeller 
P.O.  Box  158 
211  West  Bel  Air  Avenue 
Aberdeen,  MD  21001 

1  Armored  Vehicle  Technologies 
ATTN;  Coda  M.  Edwards 
PO  Box  2057 
Warren,  MI  48090 
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1  ASI  Sytems,  International 

ATTN:  Dr.  Michael  Stamatelatos 
3319  Lone  Jack  Road 
Encinitas,  CA  92024 

1  Auburn  University 

Electrical  Engineering  Department 
ATTN:  Dr.  Thomas  Shumpert 
Auburn  University,  AL  36849 

1  A.W.  Bayer  and  Associates 

ATTN:  Albert  W.  Bayer,  President 
Marina  City  Club 
4333  Admiralty  Way 
Marina  del  Rey,  CA  90292-5469 

1  Battelle 

ATTN:  TACTEC  Library  (J.N.  Huggins) 
505  King  Avenue 
Columbus,  OH  43201-2693 

1  Battelle 

Defense  and  Space  Systems  Analysis 
ATTN:  Dr.  Richard  K.  Thatcher 
505  King  Avenue 
Columbus,  OH  43201-2693 

1  Battelle 

ATTN:  Bernard  J.  Tullington 
1300  N,  17th  Street,  Suite  1520 
Arlington,  VA  22209 

3  Battelle 

Edgewood  Operations 
ATTN;  Roy  Golly 

Gene  Roecker 
Robert  Jameson 
2113  Emmorton  Park  Road 
Edgewood,  MD  21040 

1  The  BDM  Corporation 
ATTN:  Edwin  J.  Dorchak 
7915  Jones  Branch  Drive 
McLean,  VA  22102-3396 

1  The  BDM  Corporation 
ATTN:  Fred  J.  Michel 
1300  N.  17th  Street 
Arlington,  VA  22209 


1  Bell  Helicopter,  Textron 
ATTN:  Jack  R.  Johnson 
PO  Box  482 
Fort  Worth,  TX  76101 

3  BMY,  Division  of  Harsco 

ATTN:  William  J.  Wagner,  Jr. 

Ronald  W.  Jenkins 
Ed  Magalski 
PO  Box  1512 
York,  PA  17404 

1  Board  on  Army  Science  and  Technology 
National  Research  Council 

Room  MH  280 

2101  Constitution  Avenue,  NW 
Washington,  DC  20418 

2  Boeing  Aerospace 

ATTN:  Dr.  Robert  Chiavetta 
Dr.  John  Kuras 
Mail  Stop  8K17 
P.O.  Box  3999 
Seattle,  WA  98124-2499 

1  Boeing  Military  Airplanes 

ATTN;  MS  K80-08,  Jerry  White 

PO  Box  7730 

Wichita,  KA  67277-7730 

1  Boeing  Vertol  Company 
A  Division  of  Boeing  Co. 

ATTN:  MS  P30-27,  John  E.  Lyons 
PO  Box  16858 
Philadelphia,  PA  19142 

1  Booz-Allen  and  Hamilton,  Inc. 

ATTN:  Dr.  Richard  B.  Benjamin 
Suite  131,  4141  Colonel  Glenn  Hwy. 
Dayton,  OH  45431 

1  Booz-Allen  and  Hamilton,  Inc. 

ATTN;  Lee  F.  Mallett 
1300  N.  17th  Street,  Suite  1610 
Rosslyn,  VA  22209 
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2  Booz-Allen  arid  Hamilton,  Inc. 

ATTN:  John  M.  Vice 
WRDC /FIVS /SURVIAC 
Bldg  45,  Area  B 

Wright-Patterson  AFB,  OH  45433-6553 

1  John  Brown  Associates 
ATTN:  Dr.  John  A.  Brown 
PO  Box  145 

Berkeley  Heights,  NJ  07922-0145 

1  Chamberlain 

ATTN:  Mark  A.  Sackett 
PO  Box  2545 
Waterloo,  lA  50704 

1  Commander 

Combined  Arms  Combat  Development 
ATTN:  ATZL-CAP  (LTC  Morrison 
Dir,  Surv  Task  Force) 

Ft.  Leavenworth,  KS  66027-5300 

1  Commander 

Combined  Arms  Combat  Development 
ATTN:  ATZL-HFM  (Dwain  Skelton) 
Ft.  Leavenworth,  KS  66027-5300 

1  Computer  Sciences  Corporation 
ATTN:  Abner  W.  Lee 
200  Sparkman  Drive 
Huntsville,  AL  35805 

1  CRS  Sirrine,  Inc. 

ATTN:  Dr.  James  C.  Smith 
PO  Box  22427 
1177  West  Loop  South 
Houston,  TX  77227 

2  Cypress  International 
ATTN:  August  J.  Caponecchi 

James  Logan 
1201  E.  Abingdon  Drive 
Alexandria,  VA  22314 

1  DATA  Networks,  Inc. 

ATTN:  William  E.  Regan,  Jr. 

President 

288  Greenspring  Station 
Brooklandville,  MD  21022 


1  DNA 

ATTN:  LCDR  Charles  Nofziger 
6801  Telegraph  Road 
Alexandria,  VA  22310 

1  Datatec,  Inc. 

ATTN:  Donald  E.  Cudney 
President 
326  Green  Acres 
Fort  Walton,  FL  32548 

1  David  Taylor  Research  Center 
ATTN:  Dr.  Fred  J.  Fisch 
2203  Eastlake  Road 
Timonium,MD  21093-5000 

1  David  Taylor  Research  Center 
ATTN:  Robert  E.  Fuss 
HERD,  Code  177 
Portsmoutn,  VA  23709-5000 

1  David  Taylor  Research  Center 
ATTN;  Seymour  N.  Goldstein 
Code  1210 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN:  IbS.  Hansen 
Code  174 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN;  Harry  Price  Gray 
Code  1740.4 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN:  Jackson  T.  Hawkins 
Code  1740.2 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN;  Steven  L.  Cohen 
Code  1230 

Bethesda,  MD  20084-5000 
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1  David  Taylor  Research  Center 
ATTN:  Dennis  Clark 
Code  0111 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN:  John  R.  Krezel 
HERD,  Code  177.2 
Portsmouth,  VA  23709-5000 

1  David  Taylor  Research  Center 
ATTN;  Richard  E.  Metrey 
Code  01 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN:  Dr.  Paul  C.  St.  Hilaire 
Code  1210 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN:  Arthur  Marchand 
Code  2843 

Annapolis,  MD  21042 

1  David  Taylor  Research  Center 
ATTN:  Michael  Riley 
UERD,  Code  177 
Portsmouth,  VA  23709-5000 

1  David  Taylor  Research  Center 
ATTN:  J.  William  Sykes 
Code  175 

Bethesda,  MD  20084-5000 

1  David  Taylor  Research  Center 
ATTN;  Herbert  Wolk 
Code  1740.1 

Bethesda,  MD  20084-5000 

1  University  of  Dayton 

Graduate  Engineering  and  Research 
Kettering  Lab  262 
ATTN:  Dr.  Gary  Thiele,  Director 
Dayton,  OH  45469 
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1  Defense  Nuclear  Agency 
Structural  Dynamics  Section 
ATTN:  Tom  Tsai 
Washington,  DC  20305 

1  Delco  Systems  Operation 
ATTN:  John  Steen 
6767  Hollister  Avenue,  #P202 
Goleta,  CA  93117 

1  Denver  Research  Institute 
BW  228 

ATTN:  Lawrence  G.  Ullyatt 
2050  E.  Iliff  Avenue 
Denver,  CO  80208 

1  Dow  Chemical,  U.S.A 

ATTN:  Dr.  P.  Richard  Stoesser 
Contract  R&D 
1801  Building 
Midland,  MI  48674-1801 

1  Drexel  University 

ATTN:  Dr.  Pei  Chi  Chou 
College  of  Engineering 
Philadelphia,  PA  19104 

1  DuPont  Company  FPD 

ATTN:  Dr.  Oswald  R.  Bergmann 
B-1246,  1007  Market  Street 
Wilmington,  DE  19898 

1  Dynamics  Analysis  and  Test  Associates 
ATTN;  Dr.  C.  Thomas  Saveli 
2231  Faraday  Ave 
Suite  103 

Carlsbad,  CA  92008 

1  E.  I.  Dupont  TED  FMC 

ATTN;  Richard  O.  Myers  Jr. 
Wilmington,  DE  19898 

1  Eichelberger  Consulting  Company 
ATTN:  Dr.  Robert  Eichelberger 
President 

409  West  Catherine  Street 
Bel  Air,  MD  21014 
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1  Electronic  Warfare  Associates,  Inc.  3 

ATTN;  William  V.  Chiaramonte 
2071  Chain  Bridge  Road 
Vienna,  VA  22180 

1  Emprise,  Ltd. 

ATTN;  Bradshaw  Armendt,  Jr 

201  Crafton  Road  5 

Bel  Air,  MD  21014 

8  Environmental  Research  Institute  of  Michigan 
ATTN;  Mr.  K.  Augustyn 
Mr.  Kozma 
Dr.  I.  La  Haie 
Mr.  R.  Horvath 
Mr.  Arnold 
Mr.  E.  Cobb 
Mr.  B.  Morey 

Mr.  M.  Bair  1 

PO  Box  8618 
Ann  Arbor,  MI  48107 

1  E^OIR  Measurements,  Inc. 

ATTN;  Russ  Moulton  1 

PO  Box  1240 

Spotsylvania,  VA  22553-1240 

1  ERIM 

ATTN;  Stephen  R.  Stewart  2 

Exploitation  Applications  Department 
Image  Processing  Systems  Division 
PO  Box  8618 

Ann  Arbor,  MI  48107-8618 

1  USAETL/IAG 

ATTN;  Jim  Campbell  1 

Bldg  2592,  Room  S16 

Ft.  Belvoir,  VA  22060-5546 

1  FMC  Corporation 

ATTN;  Sidney  Kraus  1 

1105  Coleman  Ave,  Box  1201 
San  Jose,  CA  95108 


FMC  Corporation 
ATTN:  Ronald  S.  Beck 
Martin  Lim 
Jacob  F.  Yacoub 
881  Martin  Avenue 
Santa  Clara,  CA  95052 

FMC  Corporation 
Advanced  Systems  Center  (ASC) 
ATTN:  Charles  A.  Millard 
Scott  L.  Langlie 
Herb  Theumer 
Walter  L.  Davidson 
J.E.  Alexander 
1300  South  Second  Street 
PO  Box  59043 
Minneapolis,  MN  55459 

BDM  International 
ATTN:  Mr.  Steve  Church,  FX2B307 
7915  Jones  Branch  Drive 
McLean,  VA  22102-3396 

BDM  International 
ATTN:  Mr.  Tom  Hooker,  FF2B304 
7915  Jones  Branch  Drive 
McLean,  VA  22102-3396 

FMC  Corporation 
Defense  Systems  Group 
ATTN:  Robert  Burt 

Dennis  R.  Nitschke 
1115  Coleman  Avenue 
San  Jose,  CA  95037 

FMC  Corporation 
Naval  Systems  Division  (NSD) 
ATTN:  MIC-45,  Randall  Ellis 
Minneapolis,  MN  55421 

FMC  Corporation 
Northern  Ordnance  Division 
ATTN:  M3-11,  Barry  Brown 
4800  East  River  Road 
Minneapolis,  MN  55421 
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6  FMC  Corporation 

Ordnance  Engineering  Division 
ATTN:  H.  Croft 

M.  Hatcher 
L.  House 
J.  Jackson 
E.  Maddox 
R.  Musante 

1105  Coleman  Ave,  Box  1201 
San  Jose,  CA  95108 

1  GE  Aircraft  Engines 

ATTN:  Dr.  Roger  B.  Dunn 
One  Neumann  Way,  MD  J185 
Cincinnati,  OH  45215-6301 

1  General  Atomics 

ATTN:  Chester  J.  Everline, 

Staff  Engineer 
P.O.  Box  85608 
San  Diego,  CA  92138-5608 

1  General  Dynamics 

ATTN:  Dr.  Fred  Cleveland 
P.O,  Box  748 
Mail  Zone  5965 
Ft.  Worth,  TX  76101 

3  General  Dynamics 

ATTN:  MZ-4362H2,  Robert  Carter 
MZ-4362029,  Jim  Graciano 
MZ-4362055,  Gary  Jackman 
38500  Mound 

Sterling  Heights,  MI  48310 

3  General  Dynamics  Corporation 
ATTN:  MZ-2650,  Dave  Bergmap 
MZ-2860,  John  Romanko 
MZ-2844,  Cynthia  Waters 
PO  Box  748 

Ft.  Worth,  TX  76101-0748 

1  General  Dynamics  Land  Systems 
ATTN:  Robert  Carter 
PO  Box  1804 
Warren,  MI  48090-2074 


1  General  Dynamics  Land  Systems 
ATTN:  Dr.  Paulus  Kersten 
PO  Box  1901 
Warren,  MI  48090-2074 

1  General  Dynamics  Land  Systems 
ATTN:  William  M.  Mrdeza 
PO  Box  2045 
Warren,  MI  48090-2074 

1  General  Dynamics  Land  Systems 
ATTN:  JayA.  Lobb 
PO  Box  2074,  Mail  Zone  436-21-19 
Warren,  MI  48090-2074 

5  General  Dynamics  Land  Systems 
ATTN:  Richard  Auyer 
Otto  Renius 
N.  S.  Sridharan 
Dean  R.  Loftin 
Dr.  Phil  Lett 
PO  Box  2074 
Warren,  MI  48090-2074 

3  General  Motors  Corporation 
Research  Laboratories 
ATTN:  J.  Boyse 
J.  Joyce 
R.  Sarraga 
Warren,  MI  48090 

1  Allison  Gas  Turbine  Division 
General  Motors  Corporation 
ATTN:  John  A.  MacBain,  Ph.D.,  Supervisor 
Low  Observables  Technology 
Propulsion  Systems  Integration 
PO  Box  420,  Speed  Code  W-16 
Indianapolis,  IN  46206-0420 

1  Gettysburg  College 
Box  405 

Gettysburg,  PA  17325 

1  GTRI-RAIL-MAD 

ATTN:  Mr.  Joe  Bradley 
CRB  577 

Atlanta,  GA  30332 
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Hughes  Associates 
ATTN:  J.  Thomas  Hughes 
2730  University  Blvd. 

Suite  902 

Wheaton,  MD  20902 

INEL/EG&G 
Engineer  Lab 
ATTN:  Ray  Berry 

M.  Marx  Hintze 
PO  Box  1625 
Idaho  Falls,  ID  83451 

Interactive  Computer  Graphics  Center 
Rensselear  Polytechnic  Inst. 

ATTN:  M.  Wozny 
Troy,  NY  12181 

International  Development  Corporation 
ATTN:  Trevor  O.  Jones,  President 
One  Cleveland  Center,  Suite  2900 
1375  East  Ninth  Street 
Cleveland,  OH  44114-1724 

Intergraph 

National  Exploitation  Systems 
ATTN:  John  H.  Suter 
2051  Mercator  Drive 
Reston,  VA  22091-3413 

ISAT 

ATTN:  Roderick  Briggs 
1305  Duke  Street 
Alexandria,  VA  22314 

ITT  Defense 
ATTN;  Joseph  Conway 
1000  Wilson  Blvd. 

30th  Floor 

Arlington,  VA  22209 

Joint  Technical  Coordinating  Group 
ATTN:  Philip  Weinberg 
JTCG/AS5 
AIR-516J5 

Washington,  DC  20361-5160 


No.  of 

Copies  Organization 

1  California  Institute  of  Technology 
Jet  Propulsion  Laboratory 
ATTN:  D.  Lewis 
4800  Oak  Grove  Drive 
Pasadena,  CA  91109 

1  Kaman  Sciences  Corporation 
ATTN:  Timothy  S.  Pendergrass 
600  Boulevard  South,  Suite  208 
Huntsville,  AL  35802 

1  Ketron,  Inc. 

ATTN:  Robert  S.  Bennett 
901  Dulaney  Valley  Rd,  Suite  220 
Baltimore,  MD  21204-2600 

1  Keweenaw  Research  Center 
Michigan  Technological 
University 

ATTN:  Bill  Reynolds 
Houghton, MI  49931 

1  Lanxido  Armor  Products 
ATTN;  Dr.  Robert  A.  Wolffe 
Tralee  Industrial  Park 
Newark,  DE  19711 

2  Lincoln  Laboratory 
MIT 

ATTN;  Dr.  Robert  Shin 
Dr.  Chuck  Burt 
P.O.  Box  73 
Lexington,  MA  02173 

3  Lincoln  Laboratory 

MIT 

Surveillance  Systems  Group 
ATTN:  R.  Barnes 
G.  Knittel 
J.  Kong 
244  Wood  Street 
Lexington,  MA  02173-0073 

3  Lockheed-California  Company 
ATTN:  C.  A.  Burton 
R.  J.  Ricci 
M.  Steinberg 
Burbank,  CA  91520 


61 


No.  of 

Copies  Organization 

2  Lockheed-Georgia  Company 
ATTN:  Ottis  F.  Teuton 
J.  Tulkoff 

Dept.  72-91,  Zone  419 
Marietta,  GA  30063 

1  Lockheed  Palo  Alto  Research  Lab 
ATTN;  John  A.  DeRuntz,  JR 
0/93,  B/25I 
3251  Hanover  Street 
Palo  Alto,  CA  94304 

1  Logistics  Management  Institute 
ATTN:  Edward  D.  Simms  Jr. 

6400  Goldsboro  Road 
Bethesda,  MD  20817-5886 

1  Los  Alamos  Technical  Associates,  Inc. 
ATTN;  Johns.  Daly 

6501  Americas  Parkway,  #900 
Albuquerque,  NM  87110 

2  Los  Alamos  Technical  Associates,  Inc. 
ATTN:  James  C.  Jacobs 

Donald  M.  Lund 
8550  Arlington  Boulevard 
Suite  301 

Fairfax,  VA  22031 

1  Los  Alamos  Technical  Associates,  Inc. 
ATTN;  Thomas  Giacofci 
3020  Hamaker  Court 
Fairfax,  VA  22031 

1  LTV  Aerospace  and  Defense  Company 
ATTN;  Daniel  M.  Reedy 
PO  Box  655907 
Dallas,  TX  75265-5907 

3  Martin  Marietta  Aerospace 
ATTN:  MP-113,  Dan  Dorfman 

MP-433,  Richard  S.  Dowd 
MP-243,  Thomas  C.  D’Isepo 
PO  Box  555837 
Orlando,  FL  32855-5837 
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1  Maxwell  Laboratories,  Inc. 

ATTN;  Dr.  Michael  Holland 

8888  Balboa  Avenue 

San  Diego,  CA  92123-1506 

1  McDonnell  Douglas  Astronautic 
ATTN;  Nikolai  A.  Louie 
5301  Bolsa  Avenue 
Huntington  Beach,  CA  92647 

1  McDonnell  Douglas,  Inc. 

ATTN;  David  Hamilton 

PO  Box  516 

St.  Louis,  MO  63166 

1  McDonnell  Douglas,  Inc. 

ATTN:  Alan  R.  Parker 
3855  Lakewood  Blvd.,  MC  35-18 
Long  Beach,  CA  90846 

1  Micro  Electronics  of  North  Carolina 
ATTN:  Gershon  Kedem 
PO  Box  12889 

Research  Triangle  Park,  NC  07709 

1  MIT 

ATTN:  Dr.  S.  Benton 
RE15-416 

Cambridge,  MA  02139 

6  The  MITRE  Corporation 

ATTN;  Mr.  Edward  C.  Brady,  Vice  President 
Dr.  Robert  Henderson 
Dr.  Nicklas  Gramenopoulos 
Dr.  Narayana  Srinivasan 
Mr.  Norman  W.  Huddy 
Dr.  John  M.  Ruddy 
7525  Colshire  Drive 
McLean,  VA  22102-3184 

2  NFK  Engineering,  Inc. 

ATTN:  Dr.  Michael  P.  Pakstys 

Justin  W.  Held 
4200  Wilson  Blvd. 

Arlington,  VA  22203-1800 
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1  NFK  Engineering,  Inc. 

ATTN:  John  J.  Turner 
1125  Trotting  Horse  Lane 
Great  Falls,  VA  22066 

1  NASA- Ames  Research  Center 

ATTN;  Dr.  AJex  Woo 
Mail  Stop  227-2 
Moffett  Field,  CA  94035-1000 

1  NASA-Ames  Research  Center 
ATTN:  Leroy  Presley 
Mail  Stop  227-4 
Moffett  Field,  CA  94035-1000 

1  NAVIR  DEVCON 

ATTN;  Frank  Wenograd 
Code  6043 

Walminstor,  PA  18974 

1  North  Aircraft 

ATTN:  Dr.  Athanosis  Varvatsis 
Mail  Zone  3622/84 
1  Northrop  Ave 
Hawthorne,  CA  90250 

1  Northrop  Research  and 
Technology  Center 
ATTN:  Dr.  David  Donovan  Garber 
One  Research  Park 
Palos  Verdes  Peninsula,  CA  90274 

1  Norton  Company 

ATTN:  Ronald  K.  Bart 
1  New  Bond  Street 
Worcester,  MA  01606-2698 

1  The  Oceanus  Company 

ATTN:  RADM  Robert  H.  Gormley, 
(Ret) 

PO  Box  7069 
Menlo  Park,  CA  94026 

1  Oklahoma  State  University 

College  of  Engineering,  Architecture 
and  Technology 

ATTN:  Thomas  M.  Browder,  Jr. 
PO  Box  1925 
EglinAFB,  FL  32542 


1  Pacific  Scientific/Htl  Division 
ATTN:  Robert  F.  Aldrich 
1800  Highland  Avenue 
Duarte,  CA  91010 

1  Perceptronics,  Inc. 

ATTN:  Dean  R.  Loftin 
21111  Erwin  Street 
Woodland  Hills,  CA  91367 

1  Princeton  University 

Mathematics  Department 
Fine  Hall 
Washington  Road 
ATTN:  John  Tukey 
Princeton,  NJ  08544-1000 

1  PRI,  Inc. 

ATTN:  W.  Bushell 
Building  E4435,  Second  Floor 
Edgewood  Area-APG,  MD  21010 

1  RGB  Associates,  Inc. 

ATTN;  R.  Barakat 
Box  B 

Wayland,  MA  01778 

1  Rockwell  International  Corporation 
ATTN;  Dr.  H.  Bran  Tran 
P.O.  Box  92098 
Department  113/GBOl 
Los  Angeles,  CA  90009 

1  Rockwell  International  Corporation 
ATTN:  Keith  R.  Rathjen, 

Vice  President 

3370  Miraloma  Avenue  (031-HA01) 
Anaheim,  CA  92803-3105 

1  Rome  Air  Development  Center 

ATTN:  RADC/BRRE,  Peter  J.  Costianes 
Grifiis  Air  Force  Base,  NY  13441-5700 


1  Rome  Air  Development  Center 
RADC/OCTM 
ATTN:  Edward  Starczewski 
Building  106 

Griffis  Air  Force  Base,  NY  13441-5700 
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1  S-Cubed 

ATTN;  Michael  S.  Lancaster 
1800  Diagonal  Road,  Suite  420 
Alexandria,  VA  22314 

1  Sachs/Freeman  Associates,  Inc. 
ATTN;  Donald  W.  Lynch 

Senior  Research  Physicist 
205  Yoakum  Parkway,  #511 
Alexandria,  VA  22304 

1  SAIC 

ATTN:  Dr.  Alan  J.  Toepfer 
2109  Air  Park  Drive,  SE 
Albuquerque,  NM  87106 

1  SAIC 

ATTN;  John  H.  McNeilly, 

Senior  Scientist 
1710  Goodridge  Drive 
McLean,  VA  22102 

2  SAIC 

ATTN;  Terry  Keller 
Robert  Turner 
Suite  200 

1010  Woodman  Drive 
Dayton,  OH  45432 

1  SAIC 

ATTN:  David  R.  Garfinkle 
Malibu  Canyon  Business  Park 
26679  W.  Agoura  Road,  Suite  200 
Calabasas,  CA  91302 

2  George  Sharp  Company 
ATTN:  Dennis  M.  McCarley 

Roger  O.  Mau 
2121  Crystal  Drive 
Suite  714 

Arlington,  VA  22202 

1  Sidwell-Ross  and  Associates,  Inc. 
ATTN:  LTG  Marion  C.  Ross, 

(USA  Ret) 

Executive  Vice  President 
PO  Box  88531 
Atlanta,  GA  30338 


1  Sigma  Research  Inc. 

ATTN:  Dr.  Richard  Boss! 

4014  Hampton  Way 
Kent,  WA  98032 

1  Simula,  Inc. 

ATTN:  Joseph  W.  Coltman 
10016  South  51st  Street 
Pheonix,  AZ  85044 

1  SimTech 

ATTN:  Dr.  Annie  V.  Saylor 
3307  Bob  Wallace  Ave.,  Suite  4 
Huntsville,  AL  35807 

1  Alan  Smolen  and  Associates,  Inc. 
ATTN:  Alan  Smolen,  President 
One  Cynthia  Court 
Palm  Coast,  FL  32027-8172 

3  Southwest  Research  Institute 
ATTN:  Martin  Goland 
Alex  B.  Wenzel 
Patrick  H.  Zabel 
P.O.  Drawer  28255 
San  Antonio,  TX  78238-0255 

3  Sparta,  Inc. 

ATTN:  David  M.  McKinley 
Robert  E.  O’Connor 
Karen  M.  Rooney 
4901  Corporate  Drive 
Huntsville,  AL  35805-6201 

1  SRI  International 

ATTN:  Donald  R.  Curran 
333  Ravenswood  Ave. 

Menlo  Park,  CA  94025 

1  Star  Laboratory,  Stanford  University 
ATTN;  Dr.  Joseph  W.  Goodman 
Electrical  Engineering  Department 
233  Durand  Building 
Stanford,  CA  94305-4055 

1  University  of  Michigan 

ATTN;  Dr.  John  F.  Vesecky 
2212  Space  Research  Blvd. 

Ann  Arbor,  MI  48109-2143 
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1  Princeton  University 
ATTN;  Dr.  Curt  Callen 
Physics  Department 
PO  Box  708 
Princeton,  NJ  08544 

1  University  of  California,  San  Diego 
ATTN;  Dr.  Gordon  J.  MacDonald 
Institute  on  Global  Conflict 
and  Cooperation  (0518) 

9500  Gilman  Drive 
La  Jolla,  CA  92093-0518 

3  Structural  Dynamics  Research 
Corporation  (SDRC) 

ATTN;  R.  Ard 

W.  McClelland 
J.  Osborn 

2000  Eastman  Drive 
Milford,  OH  45150 

1  Syracuse  Research  Group 
ATTN;  Dr.  Chung-Chi  Cha 
Merrill  Lane 
Syracuse,  NY  13210 

1  System  Planning  Corporation 
ATTN;  Ann  Hafer 
1500  Wilson  Blvd 
Arlington,  VA  22209 

1  S-Cubed 

ATTN;  Robert  T.  Sedgwick 

PO  Box  1620 

La  Jolla,  CA  92038-1620 

2  TASC 

ATTN;  Richard  E.  Kinsler 
Darrell  James 
970  Mar-Wait  Drive 
Ft.  Walton  Beach,  FL  32548 

1  TASC 

ATTN;  Harry  I.  Nimon,  Jr 
1700  N.  Moore  Street,  Suite  1220 
Arlington,  VA  22209 


1  TASC 

ATTN:  COL  James  Logan  (Ret) 
1101  Wilson  Blvd, 

Suite  1500 

Arlington,  VA  22209 

1  COLSA,  Inc. 

ATTN;  Mr.  Willy  AJbanes 
P.O.  Box  1068 
Huntsville,  AL  35807-3301 

1  Techmatics,  Inc. 

ATTN:  Ronald  R.  Rickwald 
2231  Crystal  Drive 
Arlington,  VA  22202-3742 

1  Technical  Solutions,  Inc 
ATTN:  John  R.  Robbins 
P.O.  Box  1148 
Mesillia  Park,  NM  88047 
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USER  EVALUATION  SHEET/CHANGE  OF  ADDRESS 


This  laboratory  undertakes  a  continuing  effort  to  improve  the  quality  of  the  reports  it 
publishes.  Your  comments/answers  below  will  aid  us  in  our  efforts. 

1 .  Does  this  report  satisfy  a  need?  (Comment  on  purpose,  related  project,  or  other  area  of 
interest  for  which  the  report  will  be  used.)  _ _ 


2.  How,  specifically,  is  the  report  being  used?  (Information  source,  design  data,  procedure, 
source  of  ideas,  etc.)  _ 
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elaborate. _ _ 


4.  General  Comments.  What  do  you  think  should  be  changed  to  improve  future  reports? 
(Indicate  changes  to  organization,  technical  content,  format,  etc.)  _ 
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